[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:19 dist-test-slave-0b58 krb5kdc[1857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:19 dist-test-slave-0b58 krb5kdc[1857](info): set up 2 sockets
Aug 10 14:30:19 dist-test-slave-0b58 krb5kdc[1857](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 14:30:21.042330 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.002s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:21 dist-test-slave-0b58 krb5kdc[1857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:21.192448 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:33153
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:33153
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:21.338294 1870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:21.338653 1870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:21.338740 1870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:21.343348 1870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:21.343465 1870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:21.343502 1870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:21.343541 1870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:21.343592 1870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:21.350225 1870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:33153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:33153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:21.351894 1870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:21.353392 1870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:21.367290 1876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:21.368420 1870 server_base.cc:1034] running on GCE node
W20260810 14:30:21.368513 1875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:21.368981 1878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:21.369845 1870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:21.371973 1870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:21.373202 1870 hybrid_clock.cc:648] HybridClock initialized: now 1786372221373196 us; error 99 us; skew 500 ppm
Aug 10 14:30:21 dist-test-slave-0b58 krb5kdc[1857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372221, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:21.377554 1870 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:21.379012 1870 webserver.cc:460] Webserver started at http://127.1.206.126:35047/ using document root <none> and password file <none>
I20260810 14:30:21.380020 1870 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:21.380147 1870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:21.380748 1870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:21.384202 1870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b"
format_stamp: "Formatted at 2026-08-10 14:30:21 on dist-test-slave-0b58"
server_key: "c60555411db5865b00d6888a16cd7437"
server_key_iv: "275a859537968657558e2475cec95de6"
server_key_version: "encryptionkey@0"
I20260810 14:30:21.385341 1870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b"
format_stamp: "Formatted at 2026-08-10 14:30:21 on dist-test-slave-0b58"
server_key: "c60555411db5865b00d6888a16cd7437"
server_key_iv: "275a859537968657558e2475cec95de6"
server_key_version: "encryptionkey@0"
I20260810 14:30:21.391508 1870 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260810 14:30:21.395722 1886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:21.397861 1870 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:30:21.398138 1870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b"
format_stamp: "Formatted at 2026-08-10 14:30:21 on dist-test-slave-0b58"
server_key: "c60555411db5865b00d6888a16cd7437"
server_key_iv: "275a859537968657558e2475cec95de6"
server_key_version: "encryptionkey@0"
I20260810 14:30:21.398347 1870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:21.435880 1870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:21.440428 1870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:21.440764 1870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:21.456866 1870 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:33153
I20260810 14:30:21.456883 1943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:33153 every 8 connection(s)
I20260810 14:30:21.458359 1870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:21.462687 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 1870
I20260810 14:30:21.462898 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:21.463825 1944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:21.464546 1849 external_mini_cluster.cc:1428] Setting key ec2f7f6b379fac712afca2a03ce75e1d
I20260810 14:30:21.474795 1944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b: Bootstrap starting.
I20260810 14:30:21.478730 1944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:21.479945 1944 log.cc:824] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:21.483454 1944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b: No bootstrap required, opened a new log
Aug 10 14:30:21 dist-test-slave-0b58 krb5kdc[1857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:21.489874 1944 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33153 } }
I20260810 14:30:21.490322 1944 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:21.490446 1944 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d306fc5025f4cfcbbaa9b351dfe4d7b, State: Initialized, Role: FOLLOWER
I20260810 14:30:21.491436 1944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33153 } }
I20260810 14:30:21.491730 1944 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:21.491900 1944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:21.492054 1944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:21.493430 1944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33153 } }
I20260810 14:30:21.494155 1944 leader_election.cc:302] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d306fc5025f4cfcbbaa9b351dfe4d7b; no voters:
I20260810 14:30:21.494652 1944 leader_election.cc:288] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:21.494912 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:21.471162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51276 (local address 127.1.206.126:33153)
0810 14:30:21.471810 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:21.471837 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:21.471927 (+ 90us) server_negotiation.cc:407] Connection header received
0810 14:30:21.474536 (+ 2609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:21.474554 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:21.474973 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:21.475363 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:21.478061 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:21.479458 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:21.481353 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:21.482184 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:21.482436 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:21.486974 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:21.486982 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:21.487000 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:21.487042 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:21.489781 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:21.490648 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:21.490655 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:21.490661 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:21.490848 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:21.491330 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:21.491333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:21.491335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:21.492189 (+ 854us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:21.492482 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:21.493201 (+ 719us) server_negotiation.cc:299] Negotiation successful
0810 14:30:21.493541 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":209,"threads_started":1}
I20260810 14:30:21.494951 1949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:21.495231 1949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [term 1 LEADER]: Becoming Leader. State: Replica: 2d306fc5025f4cfcbbaa9b351dfe4d7b, State: Running, Role: LEADER
I20260810 14:30:21.495761 1949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33153 } }
I20260810 14:30:21.496644 1944 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:21.501004 1951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d306fc5025f4cfcbbaa9b351dfe4d7b. Latest consensus state: current_term: 1 leader_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33153 } } }
I20260810 14:30:21.500962 1950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d306fc5025f4cfcbbaa9b351dfe4d7b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33153 } } }
I20260810 14:30:21.501215 1951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:21.501215 1950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b [sys.catalog]: This master's current role is: LEADER
W20260810 14:30:21.508044 1964 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:30:21.508379 1964 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:30:21.508491 1963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:21.509469 1963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:21.518558 1963 catalog_manager.cc:1347] Generated new cluster ID: d82634571648481fa914732f8344700a
I20260810 14:30:21.518667 1963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:21.544179 1963 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:21.545361 1963 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:21.552572 1963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d306fc5025f4cfcbbaa9b351dfe4d7b: Generated new TSK 0
I20260810 14:30:21.553627 1963 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:21.600628 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33153
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:21.769229 1972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:21.769574 1972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:21.769676 1972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:21.774716 1972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:21.774813 1972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:21.774972 1972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:21.782434 1972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33153
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:21.783836 1972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:21.785144 1972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:21.798623 1977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:21.798528 1980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:21.798735 1978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:21.799808 1972 server_base.cc:1034] running on GCE node
I20260810 14:30:21.800453 1972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:21.801524 1972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:21.805119 1972 hybrid_clock.cc:648] HybridClock initialized: now 1786372221805046 us; error 69 us; skew 500 ppm
Aug 10 14:30:21 dist-test-slave-0b58 krb5kdc[1857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372221, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:21.811441 1972 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:21.812992 1972 webserver.cc:460] Webserver started at http://127.1.206.65:46177/ using document root <none> and password file <none>
I20260810 14:30:21.813647 1972 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:21.813724 1972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:21.813933 1972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:21.816811 1972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "3570bf27ea9c4f8593f87bdc1e69273e"
format_stamp: "Formatted at 2026-08-10 14:30:21 on dist-test-slave-0b58"
server_key: "54634f22bf29189e2fbf07ec2f1248b1"
server_key_iv: "e3029ef2df735e6898b97ca7783403c2"
server_key_version: "encryptionkey@0"
I20260810 14:30:21.817579 1972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "3570bf27ea9c4f8593f87bdc1e69273e"
format_stamp: "Formatted at 2026-08-10 14:30:21 on dist-test-slave-0b58"
server_key: "54634f22bf29189e2fbf07ec2f1248b1"
server_key_iv: "e3029ef2df735e6898b97ca7783403c2"
server_key_version: "encryptionkey@0"
I20260810 14:30:21.823308 1972 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 14:30:21.827028 1987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:21.829491 1972 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260810 14:30:21.829660 1972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "3570bf27ea9c4f8593f87bdc1e69273e"
format_stamp: "Formatted at 2026-08-10 14:30:21 on dist-test-slave-0b58"
server_key: "54634f22bf29189e2fbf07ec2f1248b1"
server_key_iv: "e3029ef2df735e6898b97ca7783403c2"
server_key_version: "encryptionkey@0"
I20260810 14:30:21.829794 1972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:21.846369 1972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:21.851104 1972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:21.851437 1972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:21.852406 1972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:21.854215 1972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:21.854326 1972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:21.854419 1972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:21.854483 1972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:21.878216 1972 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:36745
I20260810 14:30:21.878320 2109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:36745 every 8 connection(s)
I20260810 14:30:21.879416 1972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:21.881642 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 1972
I20260810 14:30:21.881773 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:21.882143 1849 external_mini_cluster.cc:1428] Setting key 7e496508950332b405952dc60538629b
Aug 10 14:30:21 dist-test-slave-0b58 krb5kdc[1857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372221, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:30:21.900077 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:21.882284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:38309 (local address 127.1.206.126:33153)
0810 14:30:21.882459 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:21.882467 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:21.883545 (+ 1078us) server_negotiation.cc:407] Connection header received
0810 14:30:21.885479 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:21.885483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:21.885550 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:21.885640 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:21.887097 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:21.887670 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:21.889830 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:21.890139 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:21.890412 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:21.893512 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:21.893516 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:21.893521 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:21.893558 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:21.896072 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:21.897266 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:21.897271 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:21.897273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:21.897423 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:21.898046 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:21.898050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:21.898051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:21.898411 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:21.898542 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:21.899764 (+ 1222us) server_negotiation.cc:299] Negotiation successful
0810 14:30:21.899925 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 14:30:21.901623 2114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:21.882838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33153 (local address 127.1.206.65:38309)
0810 14:30:21.883374 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:21.883436 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:21.885186 (+ 1750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:21.885877 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:21.885885 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:21.886326 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:21.886891 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:21.886906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:21.887840 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:21.887847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:21.889584 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:21.889607 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:21.890480 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:21.890485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:21.890770 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:21.891544 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:21.891563 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:21.893262 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:21.896443 (+ 3181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:21.896452 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:21.896475 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:21.897083 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:21.897585 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:21.897588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:21.897590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:21.897929 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:21.898836 (+ 907us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:21.898853 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:21.899346 (+ 493us) client_negotiation.cc:769] Sending connection context
0810 14:30:21.899643 (+ 297us) client_negotiation.cc:240] Negotiation successful
0810 14:30:21.900145 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":171,"threads_started":1}
I20260810 14:30:21.903475 2112 heartbeater.cc:347] Connected to a master server at 127.1.206.126:33153
I20260810 14:30:21.903787 2112 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:21.904534 2112 heartbeater.cc:511] Master 127.1.206.126:33153 requested a full tablet report, sending...
I20260810 14:30:21.907173 1904 ts_manager.cc:194] Registered new tserver with Master: 3570bf27ea9c4f8593f87bdc1e69273e (127.1.206.65:36745)
I20260810 14:30:21.909301 1904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:38309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:21.927110 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33153
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:22.089278 2117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:22.089649 2117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:22.089736 2117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:22.094170 2117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:22.094303 2117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:22.094411 2117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:22.101037 2117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33153
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:22.102368 2117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:22.103659 2117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:22.116601 2122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:22.116535 2123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:22.116547 2125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:22.117153 2117 server_base.cc:1034] running on GCE node
I20260810 14:30:22.117632 2117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:22.118425 2117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:22.119606 2117 hybrid_clock.cc:648] HybridClock initialized: now 1786372222119588 us; error 37 us; skew 500 ppm
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:22.123304 2117 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:22.124542 2117 webserver.cc:460] Webserver started at http://127.1.206.66:38757/ using document root <none> and password file <none>
I20260810 14:30:22.125212 2117 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:22.125319 2117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:22.125581 2117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:22.128088 2117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "aca22797913b42fba0ec05fdf0e08608"
format_stamp: "Formatted at 2026-08-10 14:30:22 on dist-test-slave-0b58"
server_key: "7ca74ce3f80dc5e54185683c67daf668"
server_key_iv: "7d2dc3fa6f857f222bc5c69084ed700b"
server_key_version: "encryptionkey@0"
I20260810 14:30:22.128851 2117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "aca22797913b42fba0ec05fdf0e08608"
format_stamp: "Formatted at 2026-08-10 14:30:22 on dist-test-slave-0b58"
server_key: "7ca74ce3f80dc5e54185683c67daf668"
server_key_iv: "7d2dc3fa6f857f222bc5c69084ed700b"
server_key_version: "encryptionkey@0"
I20260810 14:30:22.133637 2117 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 14:30:22.136790 2132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:22.138305 2117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:30:22.138485 2117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "aca22797913b42fba0ec05fdf0e08608"
format_stamp: "Formatted at 2026-08-10 14:30:22 on dist-test-slave-0b58"
server_key: "7ca74ce3f80dc5e54185683c67daf668"
server_key_iv: "7d2dc3fa6f857f222bc5c69084ed700b"
server_key_version: "encryptionkey@0"
I20260810 14:30:22.138635 2117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:22.160816 2117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:22.165062 2117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:22.165335 2117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:22.166049 2117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:22.167145 2117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:22.167232 2117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:22.167309 2117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:22.167354 2117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:22.180774 2117 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:44171
I20260810 14:30:22.180826 2258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:44171 every 8 connection(s)
I20260810 14:30:22.181968 2117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:22.187559 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 2117
I20260810 14:30:22.187712 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:22.188004 1849 external_mini_cluster.cc:1428] Setting key 568d66c9d227efcf6baf42164df0dc42
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:22.201679 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:22.184493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:51373 (local address 127.1.206.126:33153)
0810 14:30:22.184658 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:22.184662 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:22.185799 (+ 1137us) server_negotiation.cc:407] Connection header received
0810 14:30:22.187401 (+ 1602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:22.187405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:22.187482 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:22.187601 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:22.189568 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.190214 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.191683 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.191939 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.192070 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:22.196057 (+ 3987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:22.196065 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:22.196072 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:22.196117 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:22.198733 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.199616 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.199622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.199627 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.199752 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.200195 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.200199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.200201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.200524 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:22.200656 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:22.201279 (+ 623us) server_negotiation.cc:299] Negotiation successful
0810 14:30:22.201434 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 14:30:22.202521 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:22.184882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33153 (local address 127.1.206.66:51373)
0810 14:30:22.185584 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:22.185638 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:22.187118 (+ 1480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:22.187859 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:22.187877 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:22.188441 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:22.189381 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:22.189402 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.190375 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.190378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:22.191509 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:22.191523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.192132 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.192152 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:22.192431 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:22.193244 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:22.193282 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:22.195766 (+ 2484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:22.198957 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:22.198965 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:22.198983 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:22.199451 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:22.199880 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:22.199883 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:22.199884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:22.200062 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:22.200642 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:22.200648 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:22.200970 (+ 322us) client_negotiation.cc:769] Sending connection context
0810 14:30:22.201147 (+ 177us) client_negotiation.cc:240] Negotiation successful
0810 14:30:22.201476 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":282,"threads_started":1}
I20260810 14:30:22.203954 2259 heartbeater.cc:347] Connected to a master server at 127.1.206.126:33153
I20260810 14:30:22.204398 2259 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:30:22.205025 2259 heartbeater.cc:511] Master 127.1.206.126:33153 requested a full tablet report, sending...
I20260810 14:30:22.206528 1904 ts_manager.cc:194] Registered new tserver with Master: aca22797913b42fba0ec05fdf0e08608 (127.1.206.66:44171)
I20260810 14:30:22.207576 1904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:51373
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:22.230355 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33153
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:22.375792 2267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:22.376187 2267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:22.376332 2267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:22.381705 2267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:22.381856 2267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:22.381966 2267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:22.388464 2267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33153
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:22.390021 2267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:22.391294 2267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:22.404006 2274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:22.404011 2272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:22.404006 2276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:22.404389 2267 server_base.cc:1034] running on GCE node
I20260810 14:30:22.405059 2267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:22.405934 2267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:22.407182 2267 hybrid_clock.cc:648] HybridClock initialized: now 1786372222407158 us; error 42 us; skew 500 ppm
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:22.410956 2267 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:22.412091 2267 webserver.cc:460] Webserver started at http://127.1.206.67:44677/ using document root <none> and password file <none>
I20260810 14:30:22.412840 2267 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:22.412953 2267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:22.413208 2267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:22.415654 2267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "e197376b9c154c498df0d440b1ee1414"
format_stamp: "Formatted at 2026-08-10 14:30:22 on dist-test-slave-0b58"
server_key: "6a5110ba222978443e3f1db05ec76ef1"
server_key_iv: "aada882a6c2774843eeffd8fbed1dec0"
server_key_version: "encryptionkey@0"
I20260810 14:30:22.416513 2267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "e197376b9c154c498df0d440b1ee1414"
format_stamp: "Formatted at 2026-08-10 14:30:22 on dist-test-slave-0b58"
server_key: "6a5110ba222978443e3f1db05ec76ef1"
server_key_iv: "aada882a6c2774843eeffd8fbed1dec0"
server_key_version: "encryptionkey@0"
I20260810 14:30:22.421262 2267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:30:22.424861 2284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:22.426635 2267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260810 14:30:22.426844 2267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "e197376b9c154c498df0d440b1ee1414"
format_stamp: "Formatted at 2026-08-10 14:30:22 on dist-test-slave-0b58"
server_key: "6a5110ba222978443e3f1db05ec76ef1"
server_key_iv: "aada882a6c2774843eeffd8fbed1dec0"
server_key_version: "encryptionkey@0"
I20260810 14:30:22.427017 2267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:22.447096 2267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:22.451879 2267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:22.452076 2267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:22.452809 2267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:22.453697 2267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:22.453748 2267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:22.453794 2267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:22.453809 2267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:22.468931 2267 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:44807
I20260810 14:30:22.468951 2405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:44807 every 8 connection(s)
I20260810 14:30:22.470016 2267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:22.472110 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 2267
I20260810 14:30:22.472265 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:22.472631 1849 external_mini_cluster.cc:1428] Setting key 407b3a900803526e1415379a74ed44db
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:22.487670 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:22.472406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:45237 (local address 127.1.206.126:33153)
0810 14:30:22.472574 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:22.472580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:22.474078 (+ 1498us) server_negotiation.cc:407] Connection header received
0810 14:30:22.475694 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:22.475698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:22.475760 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:22.475859 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:22.477464 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.478181 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.479563 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.479843 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.479973 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:22.483208 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:22.483212 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:22.483214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:22.483245 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:22.484850 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.485518 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.485521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.485523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.485609 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.486033 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.486037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.486041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.486270 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:22.486390 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:22.487257 (+ 867us) server_negotiation.cc:299] Negotiation successful
0810 14:30:22.487463 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:30:22.489148 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:22.472942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33153 (local address 127.1.206.67:45237)
0810 14:30:22.473878 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:22.473930 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:22.475451 (+ 1521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:22.476168 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:22.476179 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:22.476686 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:22.477281 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:22.477299 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.478392 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.478396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:22.479405 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:22.479417 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.480048 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.480053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:22.480332 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:22.481297 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:22.481317 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:22.482962 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:22.485009 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:22.485017 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:22.485039 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:22.485374 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:22.485724 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:22.485728 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:22.485730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:22.485915 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:22.486392 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:22.486403 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:22.486812 (+ 409us) client_negotiation.cc:769] Sending connection context
0810 14:30:22.487192 (+ 380us) client_negotiation.cc:240] Negotiation successful
0810 14:30:22.487645 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":314,"threads_started":1}
I20260810 14:30:22.490619 2406 heartbeater.cc:347] Connected to a master server at 127.1.206.126:33153
I20260810 14:30:22.490895 2406 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:22.491458 2406 heartbeater.cc:511] Master 127.1.206.126:33153 requested a full tablet report, sending...
I20260810 14:30:22.492779 1904 ts_manager.cc:194] Registered new tserver with Master: e197376b9c154c498df0d440b1ee1414 (127.1.206.67:44807)
I20260810 14:30:22.493541 1904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:45237
I20260810 14:30:22.502027 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:22.535945 2415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:22.523825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50462 (local address 127.1.206.65:36745)
0810 14:30:22.524174 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:22.524181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:22.524208 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:30:22.524448 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:22.524455 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:22.524668 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:22.524811 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:22.525722 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.526641 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.527722 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.528153 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.528375 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:22.531416 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:22.531432 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:22.531448 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:22.531489 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:22.533790 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.534385 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.534391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.534392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.534490 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.534808 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.534814 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.534816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.535122 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:22.535401 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:22.535564 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 14:30:22.535745 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":104,"threads_started":1}
W20260810 14:30:22.537356 2019 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50462
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[1857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372222, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:22.571201 2415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:22.559219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50474 (local address 127.1.206.65:36745)
0810 14:30:22.559439 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:22.559442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:22.559637 (+ 195us) server_negotiation.cc:407] Connection header received
0810 14:30:22.559719 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:22.559722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:22.559775 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:22.559857 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:22.560941 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.561503 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.562579 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:22.562857 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:22.562975 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:22.566303 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:22.566315 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:22.566319 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:22.566362 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:22.568887 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.569536 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.569540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.569541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.569649 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:22.570002 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:22.570006 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:22.570007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:22.570245 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:22.570433 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:22.570939 (+ 506us) server_negotiation.cc:299] Negotiation successful
0810 14:30:22.571069 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260810 14:30:22.572849 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 1972
I20260810 14:30:22.582254 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 2117
I20260810 14:30:22.590000 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 2267
I20260810 14:30:22.599340 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 1870
2026-08-10T14:30:22Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2711 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[2422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[2422](info): set up 2 sockets
Aug 10 14:30:22 dist-test-slave-0b58 krb5kdc[2422](info): commencing operation
krb5kdc: starting...
W20260810 14:30:23.744033 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:23 dist-test-slave-0b58 krb5kdc[2422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:23.888386 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44995
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:44995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:24.011857 2435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:24.012193 2435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:24.012240 2435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:24.016657 2435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:24.016738 2435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:24.016759 2435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:24.016776 2435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:24.016793 2435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:24.023036 2435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:44995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:24.024530 2435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:24.025767 2435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:24.036080 2443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:24.036082 2440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:24.036089 2441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:24.036571 2435 server_base.cc:1034] running on GCE node
I20260810 14:30:24.037312 2435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:24.038609 2435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:24.039840 2435 hybrid_clock.cc:648] HybridClock initialized: now 1786372224039826 us; error 37 us; skew 500 ppm
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372224, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:24.043211 2435 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:24.044428 2435 webserver.cc:460] Webserver started at http://127.1.206.126:34905/ using document root <none> and password file <none>
I20260810 14:30:24.045045 2435 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:24.045151 2435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:24.045401 2435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:24.047636 2435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "90c2cde69b5949c984feae8ba648f12d"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "6760643a70182ad6d6a2b05e79b30057"
server_key_iv: "1e3bb103e4f9bc65ca9de781e4f9e5fe"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.048379 2435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "90c2cde69b5949c984feae8ba648f12d"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "6760643a70182ad6d6a2b05e79b30057"
server_key_iv: "1e3bb103e4f9bc65ca9de781e4f9e5fe"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.052572 2435 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:30:24.055306 2451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.056726 2435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:24.056887 2435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "90c2cde69b5949c984feae8ba648f12d"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "6760643a70182ad6d6a2b05e79b30057"
server_key_iv: "1e3bb103e4f9bc65ca9de781e4f9e5fe"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.057029 2435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:24.080694 2435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:24.084153 2435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:24.084465 2435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:24.092320 2435 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:44995
I20260810 14:30:24.092352 2506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:44995 every 8 connection(s)
I20260810 14:30:24.093446 2435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:24.096547 2507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:24.096994 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 2435
I20260810 14:30:24.097114 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:24.097405 1849 external_mini_cluster.cc:1428] Setting key 4d4a4e105a3200fcfc889a7453992a7d
I20260810 14:30:24.104442 2507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d: Bootstrap starting.
I20260810 14:30:24.107034 2507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d: Neither blocks nor log segments found. Creating new log.
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:24.107929 2507 log.cc:824] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:24.110137 2507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d: No bootstrap required, opened a new log
I20260810 14:30:24.113263 2510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.099074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34252 (local address 127.1.206.126:44995)
0810 14:30:24.099641 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.099663 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:24.099705 (+ 42us) server_negotiation.cc:407] Connection header received
0810 14:30:24.100567 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:24.100592 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:24.100989 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:24.101405 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:24.102324 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.103384 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.104386 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.104986 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.105191 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.107978 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:24.107984 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:24.108020 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:24.108069 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:24.109995 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.110534 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.110548 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.110554 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.110683 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.110995 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.110998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.111000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.111446 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:24.111666 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:24.112015 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 14:30:24.112454 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":177,"threads_started":1}
I20260810 14:30:24.114452 2507 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c2cde69b5949c984feae8ba648f12d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44995 } }
I20260810 14:30:24.114770 2507 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:24.114852 2507 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c2cde69b5949c984feae8ba648f12d, State: Initialized, Role: FOLLOWER
I20260810 14:30:24.115334 2507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c2cde69b5949c984feae8ba648f12d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44995 } }
I20260810 14:30:24.115496 2507 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:24.115607 2507 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:24.115724 2507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:24.116892 2507 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c2cde69b5949c984feae8ba648f12d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44995 } }
I20260810 14:30:24.117262 2507 leader_election.cc:302] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90c2cde69b5949c984feae8ba648f12d; no voters:
I20260810 14:30:24.117614 2507 leader_election.cc:288] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:24.117871 2512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:24.118211 2512 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [term 1 LEADER]: Becoming Leader. State: Replica: 90c2cde69b5949c984feae8ba648f12d, State: Running, Role: LEADER
I20260810 14:30:24.118558 2512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c2cde69b5949c984feae8ba648f12d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44995 } }
I20260810 14:30:24.119051 2507 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:24.120461 2514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90c2cde69b5949c984feae8ba648f12d. Latest consensus state: current_term: 1 leader_uuid: "90c2cde69b5949c984feae8ba648f12d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c2cde69b5949c984feae8ba648f12d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44995 } } }
I20260810 14:30:24.120626 2514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:24.120939 2513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90c2cde69b5949c984feae8ba648f12d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c2cde69b5949c984feae8ba648f12d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44995 } } }
I20260810 14:30:24.121037 2513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d [sys.catalog]: This master's current role is: LEADER
W20260810 14:30:24.124920 2528 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:30:24.125041 2528 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:30:24.125146 2522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:24.125917 2522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:24.132845 2522 catalog_manager.cc:1347] Generated new cluster ID: cf4d713dfdfc4aa4a42c612648dff431
I20260810 14:30:24.132956 2522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:24.162827 2522 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:24.164422 2522 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:24.171620 2522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90c2cde69b5949c984feae8ba648f12d: Generated new TSK 0
I20260810 14:30:24.172640 2522 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:24.215687 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44995
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:24.342118 2534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:24.342480 2534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:24.342531 2534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:24.348637 2534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:24.348752 2534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:24.348860 2534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:24.354976 2534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:24.356242 2534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:24.357472 2534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:24.369529 2540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:24.369613 2542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:24.369545 2539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:24.369740 2534 server_base.cc:1034] running on GCE node
I20260810 14:30:24.370419 2534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:24.371241 2534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:24.372510 2534 hybrid_clock.cc:648] HybridClock initialized: now 1786372224372482 us; error 43 us; skew 500 ppm
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372224, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:24.376444 2534 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:24.377592 2534 webserver.cc:460] Webserver started at http://127.1.206.65:38363/ using document root <none> and password file <none>
I20260810 14:30:24.378222 2534 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:24.378295 2534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:24.378489 2534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:24.380877 2534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "66601c198a8cbd455d3fa7ccded2ca29"
server_key_iv: "0cc08b6bdccc336c920f66eb28c2b7fc"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.381492 2534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "66601c198a8cbd455d3fa7ccded2ca29"
server_key_iv: "0cc08b6bdccc336c920f66eb28c2b7fc"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.385783 2534 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:30:24.388765 2549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.390311 2534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:24.390511 2534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "66601c198a8cbd455d3fa7ccded2ca29"
server_key_iv: "0cc08b6bdccc336c920f66eb28c2b7fc"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.390635 2534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:24.419642 2534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:24.424225 2534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:24.424494 2534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:24.425221 2534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:24.426276 2534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:24.426339 2534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.426416 2534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:24.426460 2534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.438758 2534 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:35739
I20260810 14:30:24.438800 2671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:35739 every 8 connection(s)
I20260810 14:30:24.439894 2534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:24.445269 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 2534
I20260810 14:30:24.445410 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:24.445698 1849 external_mini_cluster.cc:1428] Setting key 4c4a3633a0a6976f77158de6f4f8e003
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372224, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:30:24.458320 2510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.442178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:48681 (local address 127.1.206.126:44995)
0810 14:30:24.442350 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.442353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:24.443309 (+ 956us) server_negotiation.cc:407] Connection header received
0810 14:30:24.445049 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:24.445052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:24.445111 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:24.445201 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:24.446764 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.447574 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.449555 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.450048 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.450188 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.453767 (+ 3579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:24.453774 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:24.453781 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:24.453820 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:24.455686 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.456403 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.456407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.456409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.456518 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.456936 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.456941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.456944 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.457240 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:24.457365 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:24.457957 (+ 592us) server_negotiation.cc:299] Negotiation successful
0810 14:30:24.458148 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 14:30:24.459470 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.442588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:44995 (local address 127.1.206.65:48681)
0810 14:30:24.443122 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:24.443182 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:24.444779 (+ 1597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:24.445462 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:24.445471 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:24.446025 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:24.446600 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:24.446615 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.447742 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.447749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:24.449387 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:24.449404 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.450234 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.450237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:24.450401 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.451144 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:24.451162 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:24.453488 (+ 2326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:24.455856 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:24.455862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:24.455878 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:24.456207 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:24.456624 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:24.456627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:24.456629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:24.456796 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:24.457359 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:24.457365 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:24.457655 (+ 290us) client_negotiation.cc:769] Sending connection context
0810 14:30:24.457846 (+ 191us) client_negotiation.cc:240] Negotiation successful
0810 14:30:24.458250 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":140,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:30:24.461571 2672 heartbeater.cc:347] Connected to a master server at 127.1.206.126:44995
I20260810 14:30:24.461910 2672 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:24.462673 2672 heartbeater.cc:511] Master 127.1.206.126:44995 requested a full tablet report, sending...
I20260810 14:30:24.464798 2469 ts_manager.cc:194] Registered new tserver with Master: 1cb1edc6c17c4bc8acaf4bce2df73dd9 (127.1.206.65:35739)
I20260810 14:30:24.466168 2469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:48681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:24.484525 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44995
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:24.606355 2677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:24.606688 2677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:24.606737 2677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:24.611114 2677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:24.611238 2677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:24.611342 2677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:24.617169 2677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:24.618449 2677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:24.619683 2677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:24.631278 2682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:24.631325 2685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:24.631428 2677 server_base.cc:1034] running on GCE node
W20260810 14:30:24.631282 2683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:24.632100 2677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:24.632891 2677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:24.634088 2677 hybrid_clock.cc:648] HybridClock initialized: now 1786372224634067 us; error 37 us; skew 500 ppm
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372224, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:24.637204 2677 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:24.638202 2677 webserver.cc:460] Webserver started at http://127.1.206.66:39309/ using document root <none> and password file <none>
I20260810 14:30:24.638850 2677 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:24.638957 2677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:24.639201 2677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:24.641621 2677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "d8ffe98b3b9f479baa301ac162f161ae"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "3e2969471b43ecf87eb956b393119a37"
server_key_iv: "e7976700dcacd35d4896c71e0a1b9fcb"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.642311 2677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "d8ffe98b3b9f479baa301ac162f161ae"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "3e2969471b43ecf87eb956b393119a37"
server_key_iv: "e7976700dcacd35d4896c71e0a1b9fcb"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.646562 2677 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:24.649554 2692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.651072 2677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:24.651240 2677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "d8ffe98b3b9f479baa301ac162f161ae"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "3e2969471b43ecf87eb956b393119a37"
server_key_iv: "e7976700dcacd35d4896c71e0a1b9fcb"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.651427 2677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:24.667604 2677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:24.671324 2677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:24.671528 2677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:24.672132 2677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:24.673111 2677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:24.673166 2677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.673245 2677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:24.673282 2677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.683012 2677 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:45019
I20260810 14:30:24.683096 2810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:45019 every 8 connection(s)
I20260810 14:30:24.684064 2677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:24.692873 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 2677
I20260810 14:30:24.693013 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:24.693284 1849 external_mini_cluster.cc:1428] Setting key 1403436d3169c6d254937c99b93bb01d
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372224, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:24.701272 2510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.686179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:55971 (local address 127.1.206.126:44995)
0810 14:30:24.686363 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.686368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:24.687334 (+ 966us) server_negotiation.cc:407] Connection header received
0810 14:30:24.688933 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:24.688936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:24.688992 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:24.689081 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:24.690461 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.691050 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.693078 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.693345 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.693486 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.696780 (+ 3294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:24.696787 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:24.696793 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:24.696833 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:24.698380 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.699156 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.699159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.699160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.699251 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.699752 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.699755 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.699756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.699986 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:24.700077 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:24.700972 (+ 895us) server_negotiation.cc:299] Negotiation successful
0810 14:30:24.701109 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 14:30:24.702664 2813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.686632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:44995 (local address 127.1.206.66:55971)
0810 14:30:24.687152 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:24.687204 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:24.688653 (+ 1449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:24.689279 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:24.689288 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:24.689698 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:24.690263 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:24.690279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.691201 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.691204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:24.692925 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:24.692938 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.693588 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.693594 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:24.693836 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.694618 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:24.694637 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:24.696581 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:24.698524 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:24.698533 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:24.698556 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:24.699000 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:24.699368 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:24.699374 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:24.699379 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:24.699599 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:24.700116 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:24.700127 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:24.700611 (+ 484us) client_negotiation.cc:769] Sending connection context
0810 14:30:24.700873 (+ 262us) client_negotiation.cc:240] Negotiation successful
0810 14:30:24.701310 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":131,"threads_started":1}
I20260810 14:30:24.704135 2811 heartbeater.cc:347] Connected to a master server at 127.1.206.126:44995
I20260810 14:30:24.704497 2811 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:24.705061 2811 heartbeater.cc:511] Master 127.1.206.126:44995 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:24.706285 2469 ts_manager.cc:194] Registered new tserver with Master: d8ffe98b3b9f479baa301ac162f161ae (127.1.206.66:45019)
I20260810 14:30:24.706959 2469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:55971
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:24.725260 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44995
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:24.848459 2817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:24.848817 2817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:24.848901 2817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:24.853160 2817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:24.853276 2817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:24.853375 2817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:24.859222 2817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:24.860543 2817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:24.861763 2817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:24.872566 2822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:24.872648 2817 server_base.cc:1034] running on GCE node
W20260810 14:30:24.872570 2825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:24.872566 2823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:24.873404 2817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:24.874089 2817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:24.875283 2817 hybrid_clock.cc:648] HybridClock initialized: now 1786372224875262 us; error 33 us; skew 500 ppm
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372224, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:24.878580 2817 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:24.879637 2817 webserver.cc:460] Webserver started at http://127.1.206.67:42929/ using document root <none> and password file <none>
I20260810 14:30:24.880224 2817 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:24.880376 2817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:24.880580 2817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:24.882768 2817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "a0b452b044a54441a508ca72e5ddce6b"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "fbc6a94aade0218a7ec7858fd4702f6e"
server_key_iv: "9d42a33d144bc460a2bf98d20ccf826f"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.883409 2817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "a0b452b044a54441a508ca72e5ddce6b"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "fbc6a94aade0218a7ec7858fd4702f6e"
server_key_iv: "9d42a33d144bc460a2bf98d20ccf826f"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.887671 2817 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:24.890601 2832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.892180 2817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:24.892407 2817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "a0b452b044a54441a508ca72e5ddce6b"
format_stamp: "Formatted at 2026-08-10 14:30:24 on dist-test-slave-0b58"
server_key: "fbc6a94aade0218a7ec7858fd4702f6e"
server_key_iv: "9d42a33d144bc460a2bf98d20ccf826f"
server_key_version: "encryptionkey@0"
I20260810 14:30:24.892534 2817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:24.911798 2817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:24.916219 2817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:24.916452 2817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:24.917124 2817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:24.918058 2817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:24.918112 2817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.918157 2817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:24.918175 2817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:24.930377 2817 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:46423
I20260810 14:30:24.930397 2949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:46423 every 8 connection(s)
I20260810 14:30:24.931356 2817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:24.934237 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 2817
I20260810 14:30:24.934402 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:24.934749 1849 external_mini_cluster.cc:1428] Setting key d1ec836087ca0ba054edafa5fe5a0544
Aug 10 14:30:24 dist-test-slave-0b58 krb5kdc[2422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372224, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:24.946919 2510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.933499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:32817 (local address 127.1.206.126:44995)
0810 14:30:24.933718 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.933722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:24.934679 (+ 957us) server_negotiation.cc:407] Connection header received
0810 14:30:24.936392 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:24.936395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:24.936471 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:24.936565 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:24.937916 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.938487 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.939678 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.939910 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.939997 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.943025 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:24.943029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:24.943031 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:24.943061 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:24.944684 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.945302 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.945305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.945306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.945387 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.945737 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.945739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.945740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.945957 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:24.946037 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:24.946652 (+ 615us) server_negotiation.cc:299] Negotiation successful
0810 14:30:24.946771 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260810 14:30:24.947971 2952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.933930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:44995 (local address 127.1.206.67:32817)
0810 14:30:24.934452 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:24.934511 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:24.936123 (+ 1612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:24.936713 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:24.936721 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:24.937224 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:24.937760 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:24.937774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.938612 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.938614 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:24.939554 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:24.939563 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.940118 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.940122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:24.940358 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.941107 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:24.941174 (+ 67us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:24.942808 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:24.944821 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:24.944827 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:24.944844 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:24.945201 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:24.945475 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:24.945478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:24.945479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:24.945649 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:24.946106 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:24.946112 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:24.946419 (+ 307us) client_negotiation.cc:769] Sending connection context
0810 14:30:24.946602 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 14:30:24.946898 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":157,"threads_started":1}
I20260810 14:30:24.949363 2950 heartbeater.cc:347] Connected to a master server at 127.1.206.126:44995
I20260810 14:30:24.949645 2950 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:24.950176 2950 heartbeater.cc:511] Master 127.1.206.126:44995 requested a full tablet report, sending...
I20260810 14:30:24.951268 2469 ts_manager.cc:194] Registered new tserver with Master: a0b452b044a54441a508ca72e5ddce6b (127.1.206.67:46423)
I20260810 14:30:24.951898 2469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:32817
I20260810 14:30:24.962251 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:30:24.976078 2510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.967451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34264 (local address 127.1.206.126:44995)
0810 14:30:24.967604 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.967607 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:24.967750 (+ 143us) server_negotiation.cc:407] Connection header received
0810 14:30:24.967830 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:24.967833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:24.967884 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:24.967972 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:24.968841 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.969381 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.970232 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:24.970449 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:24.970532 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:24.972076 (+ 1544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:24.972079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:24.972081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:24.972109 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:24.973975 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.974501 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.974505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.974506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.974621 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:24.975006 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:24.975009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:24.975010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:24.975278 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:24.975407 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:24.975788 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 14:30:24.975935 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:30:24.983091 2469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34264:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:24.986802 2469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:25.005360 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.998616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:46423 (local address 127.0.0.1:33142)
0810 14:30:24.999390 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:24.999451 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:24.999587 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:25.000187 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:25.000193 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:25.000241 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:25.000990 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.000997 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.002202 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.002205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.003279 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.003292 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.004543 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.004546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.004763 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.004843 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 14:30:25.004973 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 14:30:25.005169 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"mutex_wait_us":764,"thread_start_us":116,"threads_started":1}
I20260810 14:30:25.005360 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.998172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:45019 (local address 127.0.0.1:39152)
0810 14:30:24.999644 (+ 1472us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:24.999657 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:24.999798 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:25.000302 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:25.000305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:25.000318 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:25.000473 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.000480 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.001900 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.001904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.003511 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.003524 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.004647 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.004650 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.004768 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.004840 (+ 72us) client_negotiation.cc:769] Sending connection context
0810 14:30:25.004973 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 14:30:25.005168 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":64,"thread_start_us":120,"threads_started":1}
I20260810 14:30:25.006181 2962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.998334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39152 (local address 127.1.206.66:45019)
0810 14:30:24.999665 (+ 1331us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.999690 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:24.999771 (+ 81us) server_negotiation.cc:407] Connection header received
0810 14:30:24.999961 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:24.999966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.000132 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.000333 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:25.000573 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.001729 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.003662 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.004513 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.004620 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.004781 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.005887 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.005998 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1220,"thread_start_us":133,"threads_started":1}
I20260810 14:30:25.006635 2965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.999021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33142 (local address 127.1.206.67:46423)
0810 14:30:24.999498 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.999512 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:24.999540 (+ 28us) server_negotiation.cc:407] Connection header received
0810 14:30:24.999785 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:24.999792 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.000018 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.000185 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:25.001113 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.002034 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.003420 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.004401 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.004519 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.004781 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.005026 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.006474 (+ 1448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":244,"threads_started":1}
I20260810 14:30:25.007076 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.998980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:35739 (local address 127.0.0.1:56836)
0810 14:30:24.999915 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:24.999929 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:25.000061 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:25.000756 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:25.000759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:25.000777 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:25.000874 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.000880 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.002332 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.002336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.003538 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.003545 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.006623 (+ 3078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.006628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.006741 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.006771 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 14:30:25.006851 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 14:30:25.006942 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"mutex_wait_us":27,"thread_start_us":96,"threads_started":1}
I20260810 14:30:25.007560 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:24.999259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56836 (local address 127.1.206.65:35739)
0810 14:30:24.999906 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:24.999912 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:25.000035 (+ 123us) server_negotiation.cc:407] Connection header received
0810 14:30:25.000425 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:25.000431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.000628 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.000782 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:25.001045 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.002149 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.004868 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.006289 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.006407 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.006551 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.007280 (+ 729us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.007392 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":104,"threads_started":1}
I20260810 14:30:25.009677 2742 tablet_service.cc:1467] Processing CreateTablet for tablet f32d2c1b734f4179ba2a06a1313dff77 (DEFAULT_TABLE table=test-table [id=6943b7750e3e4c3e8a0f6067d955e2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:25.010087 2603 tablet_service.cc:1467] Processing CreateTablet for tablet f32d2c1b734f4179ba2a06a1313dff77 (DEFAULT_TABLE table=test-table [id=6943b7750e3e4c3e8a0f6067d955e2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:25.011137 2603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f32d2c1b734f4179ba2a06a1313dff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:25.011165 2742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f32d2c1b734f4179ba2a06a1313dff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:25.011027 2882 tablet_service.cc:1467] Processing CreateTablet for tablet f32d2c1b734f4179ba2a06a1313dff77 (DEFAULT_TABLE table=test-table [id=6943b7750e3e4c3e8a0f6067d955e2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:25.012039 2882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f32d2c1b734f4179ba2a06a1313dff77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:25.017928 2967 tablet_bootstrap.cc:492] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9: Bootstrap starting.
I20260810 14:30:25.019795 2969 tablet_bootstrap.cc:492] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b: Bootstrap starting.
I20260810 14:30:25.020388 2968 tablet_bootstrap.cc:492] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae: Bootstrap starting.
I20260810 14:30:25.021193 2967 tablet_bootstrap.cc:654] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:25.022015 2967 log.cc:824] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:25.023042 2969 tablet_bootstrap.cc:654] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:25.023180 2968 tablet_bootstrap.cc:654] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:25.024026 2967 tablet_bootstrap.cc:492] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9: No bootstrap required, opened a new log
I20260810 14:30:25.023998 2968 log.cc:824] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:25.023998 2969 log.cc:824] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:25.024298 2967 ts_tablet_manager.cc:1397] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260810 14:30:25.028698 2967 raft_consensus.cc:348] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.029093 2967 raft_consensus.cc:374] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:25.029160 2967 raft_consensus.cc:729] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb1edc6c17c4bc8acaf4bce2df73dd9, State: Initialized, Role: FOLLOWER
I20260810 14:30:25.029728 2967 consensus_queue.cc:260] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.030709 2672 heartbeater.cc:503] Master 127.1.206.126:44995 was elected leader, sending a full tablet report...
I20260810 14:30:25.030905 2969 tablet_bootstrap.cc:492] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b: No bootstrap required, opened a new log
I20260810 14:30:25.030905 2967 ts_tablet_manager.cc:1428] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260810 14:30:25.030966 2968 tablet_bootstrap.cc:492] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae: No bootstrap required, opened a new log
I20260810 14:30:25.031137 2969 ts_tablet_manager.cc:1397] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260810 14:30:25.031193 2968 ts_tablet_manager.cc:1397] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260810 14:30:25.035068 2968 raft_consensus.cc:348] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.035235 2969 raft_consensus.cc:348] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.035486 2968 raft_consensus.cc:374] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:25.035501 2969 raft_consensus.cc:374] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:25.035557 2969 raft_consensus.cc:729] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b452b044a54441a508ca72e5ddce6b, State: Initialized, Role: FOLLOWER
I20260810 14:30:25.035558 2968 raft_consensus.cc:729] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ffe98b3b9f479baa301ac162f161ae, State: Initialized, Role: FOLLOWER
I20260810 14:30:25.036070 2969 consensus_queue.cc:260] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.036092 2968 consensus_queue.cc:260] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.036974 2950 heartbeater.cc:503] Master 127.1.206.126:44995 was elected leader, sending a full tablet report...
I20260810 14:30:25.037344 2969 ts_tablet_manager.cc:1428] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260810 14:30:25.037714 2811 heartbeater.cc:503] Master 127.1.206.126:44995 was elected leader, sending a full tablet report...
I20260810 14:30:25.038585 2968 ts_tablet_manager.cc:1428] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 14:30:25.038666 2975 raft_consensus.cc:482] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:25.038805 2975 raft_consensus.cc:504] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.040174 2975 leader_election.cc:288] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cb1edc6c17c4bc8acaf4bce2df73dd9 (127.1.206.65:35739), a0b452b044a54441a508ca72e5ddce6b (127.1.206.67:46423)
I20260810 14:30:25.044415 2813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:25.040499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:46423 (local address 127.1.206.66:56733)
0810 14:30:25.040635 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:25.040652 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:25.040745 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:25.041450 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:25.041453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:25.041467 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:25.041615 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.041621 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.042442 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.042447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.043271 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.043280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.043939 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.043942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.044053 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.044076 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 14:30:25.044172 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 14:30:25.044252 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":1}
I20260810 14:30:25.044415 2965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:25.040911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:56733 (local address 127.1.206.67:46423)
0810 14:30:25.041077 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:25.041083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:25.041110 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:30:25.041163 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:25.041170 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.041243 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.041324 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:25.041722 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.042324 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.043399 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.043813 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.043946 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.044000 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.044195 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.044292 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 14:30:25.044876 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:25.040507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:35739 (local address 127.1.206.66:59247)
0810 14:30:25.041156 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:25.041171 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:25.041324 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:25.041625 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:25.041628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:25.041646 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:25.041787 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.041795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.042653 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.042658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.043533 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:25.043542 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.044324 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.044328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:25.044435 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.044466 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 14:30:25.044624 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 14:30:25.044713 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":182,"thread_start_us":116,"threads_started":1}
I20260810 14:30:25.044888 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:25.040529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:59247 (local address 127.1.206.65:35739)
0810 14:30:25.040661 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:25.040669 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:25.041249 (+ 580us) server_negotiation.cc:407] Connection header received
0810 14:30:25.041437 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:25.041441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.041504 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.041600 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:25.041971 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.042518 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.043683 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.044160 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.044331 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.044385 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.044668 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.044763 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:30:25.045310 2902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32d2c1b734f4179ba2a06a1313dff77" candidate_uuid: "d8ffe98b3b9f479baa301ac162f161ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b452b044a54441a508ca72e5ddce6b" is_pre_election: true
I20260810 14:30:25.045718 2624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32d2c1b734f4179ba2a06a1313dff77" candidate_uuid: "d8ffe98b3b9f479baa301ac162f161ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" is_pre_election: true
I20260810 14:30:25.045820 2902 raft_consensus.cc:2454] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ffe98b3b9f479baa301ac162f161ae in term 0.
I20260810 14:30:25.046023 2624 raft_consensus.cc:2454] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ffe98b3b9f479baa301ac162f161ae in term 0.
I20260810 14:30:25.046447 2693 leader_election.cc:302] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0b452b044a54441a508ca72e5ddce6b, d8ffe98b3b9f479baa301ac162f161ae; no voters:
I20260810 14:30:25.046766 2975 raft_consensus.cc:2781] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:25.046850 2975 raft_consensus.cc:482] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:25.046885 2975 raft_consensus.cc:3037] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:25.048223 2975 raft_consensus.cc:504] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.048750 2975 leader_election.cc:288] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [CANDIDATE]: Term 1 election: Requested vote from peers 1cb1edc6c17c4bc8acaf4bce2df73dd9 (127.1.206.65:35739), a0b452b044a54441a508ca72e5ddce6b (127.1.206.67:46423)
I20260810 14:30:25.049132 2624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32d2c1b734f4179ba2a06a1313dff77" candidate_uuid: "d8ffe98b3b9f479baa301ac162f161ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9"
I20260810 14:30:25.049177 2902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f32d2c1b734f4179ba2a06a1313dff77" candidate_uuid: "d8ffe98b3b9f479baa301ac162f161ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b452b044a54441a508ca72e5ddce6b"
I20260810 14:30:25.049280 2624 raft_consensus.cc:3037] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:25.049320 2902 raft_consensus.cc:3037] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:25.050407 2624 raft_consensus.cc:2454] T f32d2c1b734f4179ba2a06a1313dff77 P 1cb1edc6c17c4bc8acaf4bce2df73dd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ffe98b3b9f479baa301ac162f161ae in term 1.
I20260810 14:30:25.050590 2902 raft_consensus.cc:2454] T f32d2c1b734f4179ba2a06a1313dff77 P a0b452b044a54441a508ca72e5ddce6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ffe98b3b9f479baa301ac162f161ae in term 1.
I20260810 14:30:25.050767 2694 leader_election.cc:302] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cb1edc6c17c4bc8acaf4bce2df73dd9, d8ffe98b3b9f479baa301ac162f161ae; no voters:
I20260810 14:30:25.050943 2975 raft_consensus.cc:2781] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:25.051067 2975 raft_consensus.cc:686] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [term 1 LEADER]: Becoming Leader. State: Replica: d8ffe98b3b9f479baa301ac162f161ae, State: Running, Role: LEADER
I20260810 14:30:25.051433 2975 consensus_queue.cc:237] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } }
I20260810 14:30:25.055114 2468 catalog_manager.cc:5495] T f32d2c1b734f4179ba2a06a1313dff77 P d8ffe98b3b9f479baa301ac162f161ae reported cstate change: term changed from 0 to 1, leader changed from <none> to d8ffe98b3b9f479baa301ac162f161ae (127.1.206.66). New cstate: current_term: 1 leader_uuid: "d8ffe98b3b9f479baa301ac162f161ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8ffe98b3b9f479baa301ac162f161ae" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cb1edc6c17c4bc8acaf4bce2df73dd9" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0b452b044a54441a508ca72e5ddce6b" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46423 } health_report { overall_health: UNKNOWN } } }
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:25.074069 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:25.063609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.1.206.65:35739)
0810 14:30:25.063805 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:25.063810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:25.064029 (+ 219us) server_negotiation.cc:407] Connection header received
0810 14:30:25.064291 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:25.064296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.064353 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.064468 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:25.065247 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.065777 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.066815 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.067043 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.067141 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.070239 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:25.070257 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:25.070272 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:25.070307 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:25.072242 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:25.072771 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:25.072777 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:25.072778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:25.072866 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:25.073115 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:25.073117 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:25.073118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:25.073422 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:25.073577 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.073746 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.073856 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372225, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372225, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:25.105417 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:25.095548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56854 (local address 127.1.206.65:35739)
0810 14:30:25.095717 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:25.095723 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:25.095921 (+ 198us) server_negotiation.cc:407] Connection header received
0810 14:30:25.096098 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:25.096102 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.096155 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.096250 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:25.097040 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.097638 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.098579 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.098835 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.098957 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.101922 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:25.101925 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:25.101927 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:25.101957 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:25.103515 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:25.104001 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:25.104009 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:25.104010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:25.104091 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:25.104450 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:25.104454 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:25.104455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:25.104646 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:25.104789 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.105104 (+ 315us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.105251 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:25.135550 2966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:25.125577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.1.206.65:35739)
0810 14:30:25.125769 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:25.125773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:25.125834 (+ 61us) server_negotiation.cc:407] Connection header received
0810 14:30:25.125957 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:25.125959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:25.126014 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:25.126108 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:25.127035 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.127615 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.128711 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:25.128952 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:25.129144 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:25.131859 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:25.131863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:25.131865 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:25.131898 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:25.133643 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:25.134153 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:25.134156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:25.134157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:25.134283 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:25.134576 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:25.134580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:25.134581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:25.134782 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:25.134896 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:25.135255 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 14:30:25.135381 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260810 14:30:25.138331 2581 tablet_service.cc:2908] Rejecting scan request for tablet f32d2c1b734f4179ba2a06a1313dff77: Uninitialized: clean time has not yet been initialized
I20260810 14:30:25.141080 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 2534
I20260810 14:30:25.149648 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 2677
I20260810 14:30:25.158169 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 2817
I20260810 14:30:25.167019 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 2435
2026-08-10T14:30:25Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2565 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2993](info): set up 2 sockets
Aug 10 14:30:25 dist-test-slave-0b58 krb5kdc[2993](info): commencing operation
krb5kdc: starting...
W20260810 14:30:26.262598 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:26 dist-test-slave-0b58 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:26.395618 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:41327
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:45419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:41327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:26.515856 3006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:26.516227 3006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:26.516340 3006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:26.520540 3006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:26.520659 3006 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 14:30:26.520694 3006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:26.520738 3006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:26.520798 3006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:26.520839 3006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:26.526883 3006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:41327
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:41327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:26.528146 3006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:26.529356 3006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:26.538631 3012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:26.538806 3006 server_base.cc:1034] running on GCE node
W20260810 14:30:26.538666 3015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:26.538604 3013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:26.539583 3006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:26.540894 3006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:26.542097 3006 hybrid_clock.cc:648] HybridClock initialized: now 1786372226542068 us; error 48 us; skew 500 ppm
Aug 10 14:30:26 dist-test-slave-0b58 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372226, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:26.545288 3006 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:26.546325 3006 webserver.cc:460] Webserver started at http://127.1.206.126:36163/ using document root <none> and password file <none>
I20260810 14:30:26.546934 3006 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:26.547037 3006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:26.547297 3006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:26.549577 3006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "6998691b74c84e5983dff484fb6d6642"
format_stamp: "Formatted at 2026-08-10 14:30:26 on dist-test-slave-0b58"
server_key: "8bbde7c038f166a4c9e95969ac80af8f"
server_key_iv: "b07d2011921528c4209bfa97deb5e236"
server_key_version: "encryptionkey@0"
I20260810 14:30:26.550184 3006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "6998691b74c84e5983dff484fb6d6642"
format_stamp: "Formatted at 2026-08-10 14:30:26 on dist-test-slave-0b58"
server_key: "8bbde7c038f166a4c9e95969ac80af8f"
server_key_iv: "b07d2011921528c4209bfa97deb5e236"
server_key_version: "encryptionkey@0"
I20260810 14:30:26.554270 3006 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:26.557054 3022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:26.558461 3006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:26.558666 3006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "6998691b74c84e5983dff484fb6d6642"
format_stamp: "Formatted at 2026-08-10 14:30:26 on dist-test-slave-0b58"
server_key: "8bbde7c038f166a4c9e95969ac80af8f"
server_key_iv: "b07d2011921528c4209bfa97deb5e236"
server_key_version: "encryptionkey@0"
I20260810 14:30:26.558815 3006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:26.587117 3006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:26.590893 3006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:26.591144 3006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:26.600451 3006 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:41327
I20260810 14:30:26.600479 3088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:41327 every 8 connection(s)
I20260810 14:30:26.601505 3006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:26.603896 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 3006
I20260810 14:30:26.604046 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:26.604377 1849 external_mini_cluster.cc:1428] Setting key a197cdea12db4c8ee3c3734386aa85a5
I20260810 14:30:26.604813 3089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:26.612713 3089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: Bootstrap starting.
Aug 10 14:30:26 dist-test-slave-0b58 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:26.615448 3089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:26.617208 3089 log.cc:824] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:26.619978 3089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: No bootstrap required, opened a new log
I20260810 14:30:26.621237 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:26.605866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54432 (local address 127.1.206.126:41327)
0810 14:30:26.606367 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:26.606393 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:26.606439 (+ 46us) server_negotiation.cc:407] Connection header received
0810 14:30:26.607298 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:26.607323 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:26.607789 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:26.608197 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:26.609001 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.610519 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.611502 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.612225 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.612446 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:26.615362 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:26.615371 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:26.615392 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:26.615430 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:26.617732 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:26.618379 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:26.618387 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:26.618394 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:26.618543 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:26.618836 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:26.618839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:26.618841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:26.619407 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:26.619651 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:26.619917 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 14:30:26.620247 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":145,"threads_started":1}
I20260810 14:30:26.623978 3089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6998691b74c84e5983dff484fb6d6642" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41327 } }
I20260810 14:30:26.624217 3089 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:26.624310 3089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6998691b74c84e5983dff484fb6d6642, State: Initialized, Role: FOLLOWER
I20260810 14:30:26.624743 3089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6998691b74c84e5983dff484fb6d6642" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41327 } }
I20260810 14:30:26.624931 3089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:26.625000 3089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:26.625103 3089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:26.626235 3089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6998691b74c84e5983dff484fb6d6642" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41327 } }
I20260810 14:30:26.626538 3089 leader_election.cc:302] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6998691b74c84e5983dff484fb6d6642; no voters:
I20260810 14:30:26.626816 3089 leader_election.cc:288] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:26.626969 3095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:26.627226 3095 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [term 1 LEADER]: Becoming Leader. State: Replica: 6998691b74c84e5983dff484fb6d6642, State: Running, Role: LEADER
I20260810 14:30:26.627573 3095 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6998691b74c84e5983dff484fb6d6642" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41327 } }
I20260810 14:30:26.628073 3089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:26.629379 3098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6998691b74c84e5983dff484fb6d6642. Latest consensus state: current_term: 1 leader_uuid: "6998691b74c84e5983dff484fb6d6642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6998691b74c84e5983dff484fb6d6642" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41327 } } }
I20260810 14:30:26.629648 3098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:26.630342 3096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6998691b74c84e5983dff484fb6d6642" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6998691b74c84e5983dff484fb6d6642" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41327 } } }
I20260810 14:30:26.630450 3096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642 [sys.catalog]: This master's current role is: LEADER
W20260810 14:30:26.633985 3114 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:30:26.634074 3114 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:30:26.634162 3110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:26.634895 3110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:26.640971 3110 catalog_manager.cc:1347] Generated new cluster ID: b0c932b3c6c14a94a67cdc67ab1c7804
I20260810 14:30:26.641111 3110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:26.654954 3110 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:26.656018 3110 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:26.666673 3110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: Generated new TSK 0
I20260810 14:30:26.667554 3110 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:26.703893 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41327
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:45419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:26.843641 3119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:26.843930 3119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:26.843976 3119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:26.848196 3119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:26.848304 3119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:26.848348 3119 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:30:26.848414 3119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:26.854157 3119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:41327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:26.855396 3119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:26.856530 3119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:26.866854 3127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:26.866861 3124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:26.866899 3125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:26.867108 3119 server_base.cc:1034] running on GCE node
I20260810 14:30:26.867702 3119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:26.868436 3119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:26.869650 3119 hybrid_clock.cc:648] HybridClock initialized: now 1786372226869611 us; error 51 us; skew 500 ppm
Aug 10 14:30:26 dist-test-slave-0b58 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372226, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:26.872809 3119 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:26.873821 3119 webserver.cc:460] Webserver started at http://127.1.206.65:43867/ using document root <none> and password file <none>
I20260810 14:30:26.874440 3119 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:26.874509 3119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:26.874764 3119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:26.877107 3119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "9a4f17015c5646e897ec0fb61f4362f8"
format_stamp: "Formatted at 2026-08-10 14:30:26 on dist-test-slave-0b58"
server_key: "45d65293eee597e572bcdfd9f74c6f9b"
server_key_iv: "04956fbb7ff241521879c6d0db734653"
server_key_version: "encryptionkey@0"
I20260810 14:30:26.877745 3119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "9a4f17015c5646e897ec0fb61f4362f8"
format_stamp: "Formatted at 2026-08-10 14:30:26 on dist-test-slave-0b58"
server_key: "45d65293eee597e572bcdfd9f74c6f9b"
server_key_iv: "04956fbb7ff241521879c6d0db734653"
server_key_version: "encryptionkey@0"
I20260810 14:30:26.881891 3119 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:30:26.884615 3134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:26.885988 3119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:30:26.886142 3119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "9a4f17015c5646e897ec0fb61f4362f8"
format_stamp: "Formatted at 2026-08-10 14:30:26 on dist-test-slave-0b58"
server_key: "45d65293eee597e572bcdfd9f74c6f9b"
server_key_iv: "04956fbb7ff241521879c6d0db734653"
server_key_version: "encryptionkey@0"
I20260810 14:30:26.886272 3119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:26.907790 3119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:26.912120 3119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:26.912443 3119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:26.914184 3119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:26.914284 3119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:26.914362 3119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:26.914414 3119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:30:26 dist-test-slave-0b58 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372226, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:26.927174 3119 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:33921
I20260810 14:30:26.927259 3257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:33921 every 8 connection(s)
I20260810 14:30:26.928531 3119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:26.931030 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:26.915323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:46555 (local address 127.1.206.126:41327)
0810 14:30:26.915477 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:26.915482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:26.916732 (+ 1250us) server_negotiation.cc:407] Connection header received
0810 14:30:26.918050 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:26.918054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:26.918124 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:26.918250 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:26.920241 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.921230 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.922723 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.923126 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.923263 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:26.926455 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:26.926458 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:26.926460 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:26.926492 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:26.928412 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:26.929232 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:26.929236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:26.929238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:26.929374 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:26.929805 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:26.929809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:26.929810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:26.930032 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:26.930154 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:26.930695 (+ 541us) server_negotiation.cc:299] Negotiation successful
0810 14:30:26.930856 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 14:30:26.931936 3144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:26.915890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41327 (local address 127.1.206.65:46555)
0810 14:30:26.916538 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:26.916591 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:26.917757 (+ 1166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:26.918530 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:26.918543 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:26.919116 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:26.920002 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:26.920031 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.921410 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.921414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:26.922578 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:26.922590 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.923336 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.923341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:26.923594 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:26.924355 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:26.924374 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:26.926218 (+ 1844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:26.928556 (+ 2338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:26.928563 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:26.928579 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:26.929057 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:26.929525 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:26.929528 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:26.929530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:26.929682 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:26.930155 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:26.930163 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:26.930433 (+ 270us) client_negotiation.cc:769] Sending connection context
0810 14:30:26.930635 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 14:30:26.931023 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":163,"threads_started":1}
I20260810 14:30:26.933334 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 3119
I20260810 14:30:26.933461 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:26.933523 3259 heartbeater.cc:347] Connected to a master server at 127.1.206.126:41327
I20260810 14:30:26.933686 3259 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:26.933817 1849 external_mini_cluster.cc:1428] Setting key 6ffc78b9c4cfbdcf5896f5f3dd6645b1
I20260810 14:30:26.934298 3259 heartbeater.cc:511] Master 127.1.206.126:41327 requested a full tablet report, sending...
I20260810 14:30:26.936457 3040 ts_manager.cc:194] Registered new tserver with Master: 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65:33921)
I20260810 14:30:26.937669 3040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:46555
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:30:26.946518 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:26.936145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:47267 (local address 127.1.206.126:41327)
0810 14:30:26.937821 (+ 1676us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:26.937828 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:26.937848 (+ 20us) server_negotiation.cc:407] Connection header received
0810 14:30:26.937896 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:26.937901 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:26.937955 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:26.938051 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:26.938691 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.939339 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.940503 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.940942 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.941071 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:26.942436 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:26.942442 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:26.942449 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:26.942488 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:26.944475 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:26.944955 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:26.944959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:26.944961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:26.945063 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:26.945399 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:26.945405 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:26.945407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:26.945688 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:26.945815 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:26.946145 (+ 330us) server_negotiation.cc:299] Negotiation successful
0810 14:30:26.946303 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1569}
I20260810 14:30:26.946535 3265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:26.936090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41327 (local address 127.1.206.65:47267)
0810 14:30:26.936466 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:26.936484 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:26.936589 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:26.938099 (+ 1510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:26.938103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:26.938369 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:26.938544 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:26.938552 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.939488 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.939491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:26.940377 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:26.940388 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:26.941098 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:26.941101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:26.941216 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:26.941826 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:26.941840 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:26.942235 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:26.944601 (+ 2366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:26.944605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:26.944606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:26.944843 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:26.945177 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:26.945180 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:26.945181 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:26.945273 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:26.945833 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:26.945835 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:26.945935 (+ 100us) client_negotiation.cc:769] Sending connection context
0810 14:30:26.946034 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 14:30:26.946362 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":120,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:26.968014 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41327
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:45419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:27.087749 3268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:27.088109 3268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:27.088225 3268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:27.092741 3268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:27.092846 3268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:27.092926 3268 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:30:27.093025 3268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:27.098860 3268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:41327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:27.100121 3268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:27.101317 3268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:27.111845 3278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:27.111847 3275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:27.111845 3274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:27.111910 3268 server_base.cc:1034] running on GCE node
I20260810 14:30:27.112643 3268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:27.113394 3268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:27.114605 3268 hybrid_clock.cc:648] HybridClock initialized: now 1786372227114589 us; error 32 us; skew 500 ppm
Aug 10 14:30:27 dist-test-slave-0b58 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372227, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:27.117638 3268 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:27.118604 3268 webserver.cc:460] Webserver started at http://127.1.206.66:43935/ using document root <none> and password file <none>
I20260810 14:30:27.119204 3268 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:27.119270 3268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:27.119513 3268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:27.122104 3268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "76f93b08528145b5b163d11bdc048161"
format_stamp: "Formatted at 2026-08-10 14:30:27 on dist-test-slave-0b58"
server_key: "50ff28d17240f737ff0cdea132e7e4a6"
server_key_iv: "b58f750d1ba3c471c2954f64f6af70fa"
server_key_version: "encryptionkey@0"
I20260810 14:30:27.122733 3268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "76f93b08528145b5b163d11bdc048161"
format_stamp: "Formatted at 2026-08-10 14:30:27 on dist-test-slave-0b58"
server_key: "50ff28d17240f737ff0cdea132e7e4a6"
server_key_iv: "b58f750d1ba3c471c2954f64f6af70fa"
server_key_version: "encryptionkey@0"
I20260810 14:30:27.126857 3268 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:27.129782 3285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:27.131212 3268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:30:27.131388 3268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "76f93b08528145b5b163d11bdc048161"
format_stamp: "Formatted at 2026-08-10 14:30:27 on dist-test-slave-0b58"
server_key: "50ff28d17240f737ff0cdea132e7e4a6"
server_key_iv: "b58f750d1ba3c471c2954f64f6af70fa"
server_key_version: "encryptionkey@0"
I20260810 14:30:27.131541 3268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:27.141577 3268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:27.145141 3268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:27.145367 3268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:27.147032 3268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:27.147123 3268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:27.147199 3268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:27.147244 3268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:30:27 dist-test-slave-0b58 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372227, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:27.159564 3268 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:37059
I20260810 14:30:27.159648 3405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:37059 every 8 connection(s)
I20260810 14:30:27.160593 3268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:27.166170 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 3268
I20260810 14:30:27.166352 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:27.166671 1849 external_mini_cluster.cc:1428] Setting key 7ad502fb586add1dd526f48b18cdce8c
I20260810 14:30:27.169456 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.147929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:57045 (local address 127.1.206.126:41327)
0810 14:30:27.148068 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.148072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.149216 (+ 1144us) server_negotiation.cc:407] Connection header received
0810 14:30:27.150437 (+ 1221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.150444 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.150516 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.150610 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:27.152693 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.153357 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.154982 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.155435 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.155585 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.158911 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:27.158916 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:27.158919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:27.158954 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:27.166649 (+ 7695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.167483 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.167487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.167488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.167579 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.168007 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.168011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.168013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.168355 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:27.168507 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.169141 (+ 634us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.169289 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 14:30:27.170542 3294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.148553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41327 (local address 127.1.206.66:57045)
0810 14:30:27.149055 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.149099 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.150103 (+ 1004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.151158 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.151171 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.151690 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:27.152477 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.152504 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.153505 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.153507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.154822 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.154834 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.155668 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.155673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.155922 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.156706 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:27.156723 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:27.158685 (+ 1962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:27.166834 (+ 8149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.166843 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.166865 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.167358 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.167692 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.167695 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.167697 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.167892 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.168511 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:27.168521 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:27.168841 (+ 320us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.169089 (+ 248us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.169491 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":139,"threads_started":1}
I20260810 14:30:27.172158 3406 heartbeater.cc:347] Connected to a master server at 127.1.206.126:41327
I20260810 14:30:27.172376 3406 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:27.173022 3406 heartbeater.cc:511] Master 127.1.206.126:41327 requested a full tablet report, sending...
I20260810 14:30:27.174304 3040 ts_manager.cc:194] Registered new tserver with Master: 76f93b08528145b5b163d11bdc048161 (127.1.206.66:37059)
I20260810 14:30:27.175235 3040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:57045
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:30:27.188387 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.176063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:43833 (local address 127.1.206.126:41327)
0810 14:30:27.176216 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.176221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.176538 (+ 317us) server_negotiation.cc:407] Connection header received
0810 14:30:27.176646 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.176651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.176702 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.176795 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:27.177488 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.178346 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.179264 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.179485 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.179607 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.181127 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:27.181131 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:27.181134 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:27.181163 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:27.183620 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.184224 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.184230 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.184233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.184375 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.186960 (+ 2585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.186965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.186968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.187384 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:27.187495 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.187984 (+ 489us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.188147 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 14:30:27.192879 3413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.176075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41327 (local address 127.1.206.66:43833)
0810 14:30:27.176425 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.176442 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.176553 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.176846 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.176849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.177210 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:27.177336 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.177345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.178493 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.178496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.179146 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.179156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.179668 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.179675 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.179823 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.180489 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:27.180501 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:27.180973 (+ 472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:27.183772 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.183778 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.183782 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.184079 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.184507 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.184512 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.184516 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.184615 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.187594 (+ 2979us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:27.187597 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:27.187736 (+ 139us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.187862 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.188076 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":104,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:27.201188 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41327
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:45419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:27.386358 3415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:27.386885 3415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:27.386963 3415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:27.393181 3415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:27.393301 3415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:27.393380 3415 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:30:27.393437 3415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:27.401625 3415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:41327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:27.403321 3415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:27.404978 3415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:27.421275 3421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:27.421275 3422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:27.421425 3424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:27.421690 3415 server_base.cc:1034] running on GCE node
I20260810 14:30:27.422485 3415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:27.423596 3415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:27.424950 3415 hybrid_clock.cc:648] HybridClock initialized: now 1786372227424860 us; error 109 us; skew 500 ppm
Aug 10 14:30:27 dist-test-slave-0b58 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372227, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:27.430522 3415 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:27.432114 3415 webserver.cc:460] Webserver started at http://127.1.206.67:34541/ using document root <none> and password file <none>
I20260810 14:30:27.433094 3415 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:27.433210 3415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:27.433655 3415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:27.437445 3415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "eb305c104021456bb7827bd179006284"
format_stamp: "Formatted at 2026-08-10 14:30:27 on dist-test-slave-0b58"
server_key: "9a773b0b1d13bed71b4c5f746f18da5d"
server_key_iv: "c98cbc3bacd1c7340d9b810bef157058"
server_key_version: "encryptionkey@0"
I20260810 14:30:27.438526 3415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "eb305c104021456bb7827bd179006284"
format_stamp: "Formatted at 2026-08-10 14:30:27 on dist-test-slave-0b58"
server_key: "9a773b0b1d13bed71b4c5f746f18da5d"
server_key_iv: "c98cbc3bacd1c7340d9b810bef157058"
server_key_version: "encryptionkey@0"
I20260810 14:30:27.445479 3415 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260810 14:30:27.450181 3431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:27.452217 3415 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:27.452545 3415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "eb305c104021456bb7827bd179006284"
format_stamp: "Formatted at 2026-08-10 14:30:27 on dist-test-slave-0b58"
server_key: "9a773b0b1d13bed71b4c5f746f18da5d"
server_key_iv: "c98cbc3bacd1c7340d9b810bef157058"
server_key_version: "encryptionkey@0"
I20260810 14:30:27.452757 3415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:27.469313 3415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:27.475607 3415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:27.476006 3415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:27.478597 3415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:27.478677 3415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:27.478746 3415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:27.478849 3415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:30:27 dist-test-slave-0b58 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372227, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:27.501636 3415 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:43935
I20260810 14:30:27.501724 3553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:43935 every 8 connection(s)
I20260810 14:30:27.503398 3415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:27.507619 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.480235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:54315 (local address 127.1.206.126:41327)
0810 14:30:27.480487 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.480498 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.482713 (+ 2215us) server_negotiation.cc:407] Connection header received
0810 14:30:27.484698 (+ 1985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.484704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.484825 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.484928 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:27.487773 (+ 2845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.488859 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.491235 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.491750 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.491955 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.500197 (+ 8242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:27.500202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:27.500204 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:27.500319 (+ 115us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:27.503094 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.504636 (+ 1542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.504642 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.504644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.504913 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.505642 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.505646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.505647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.506036 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:27.506204 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.507200 (+ 996us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.507443 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260810 14:30:27.509276 3441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.481475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41327 (local address 127.1.206.67:54315)
0810 14:30:27.482396 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.482479 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.484130 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.485619 (+ 1489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.485631 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.486413 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:27.487502 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.487538 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.489123 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.489127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.491000 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.491022 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.492030 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.492035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.492481 (+ 446us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.495742 (+ 3261us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:27.495784 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:27.499635 (+ 3851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:27.503391 (+ 3756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.503400 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.503427 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.504186 (+ 759us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.505182 (+ 996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.505187 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.505204 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.505455 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.506264 (+ 809us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:27.506273 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:27.506742 (+ 469us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.507037 (+ 295us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.507545 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":287,"threads_started":1}
I20260810 14:30:27.511672 3554 heartbeater.cc:347] Connected to a master server at 127.1.206.126:41327
I20260810 14:30:27.511920 3554 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:27.513028 3554 heartbeater.cc:511] Master 127.1.206.126:41327 requested a full tablet report, sending...
I20260810 14:30:27.513857 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 3415
I20260810 14:30:27.514055 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:27.514474 1849 external_mini_cluster.cc:1428] Setting key b05d1121373994fd3166755e4532f077
I20260810 14:30:27.515027 3041 ts_manager.cc:194] Registered new tserver with Master: eb305c104021456bb7827bd179006284 (127.1.206.67:43935)
I20260810 14:30:27.516332 3041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:54315
I20260810 14:30:27.517932 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:30:27.532473 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.515815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44595 (local address 127.1.206.126:41327)
0810 14:30:27.515995 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.516002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.516615 (+ 613us) server_negotiation.cc:407] Connection header received
0810 14:30:27.517000 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.517004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.517088 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.517222 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:27.518248 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.519309 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.520666 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.521395 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.521617 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.526980 (+ 5363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:27.526986 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:27.526989 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:27.527046 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:27.529627 (+ 2581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.530584 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.530591 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.530597 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.530755 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.531296 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.531299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.531301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.531583 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:27.531730 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.532043 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.532292 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:30:27.532492 3561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.515818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41327 (local address 127.1.206.67:44595)
0810 14:30:27.516484 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.516503 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.516733 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.517253 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.517260 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.517664 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:27.518019 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.518040 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.519548 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.519552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.520492 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.520505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.521733 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.521743 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.521975 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.523190 (+ 1215us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:27.523239 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:27.524162 (+ 923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:27.529998 (+ 5836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.530002 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.530004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.530377 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.530949 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:27.530953 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:27.530955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:27.531127 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:27.531720 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:27.531723 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:27.531837 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.531956 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.532232 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":34,"thread_start_us":195,"threads_started":1}
Aug 10 14:30:27 dist-test-slave-0b58 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372227, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:30:27 dist-test-slave-0b58 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372227, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:27.563932 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.549258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54434 (local address 127.1.206.126:41327)
0810 14:30:27.549564 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.549570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.549856 (+ 286us) server_negotiation.cc:407] Connection header received
0810 14:30:27.549998 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.550001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.550058 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.550153 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:27.550944 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.551640 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.552729 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.553016 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.553124 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.557829 (+ 4705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:27.557834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:27.557837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:27.557884 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:27.560659 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.561533 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.561537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.561539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.561681 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:27.562204 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:27.562215 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:27.562217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:27.562612 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:27.562936 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.563406 (+ 470us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.563641 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260810 14:30:27.568964 3040 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:27.573545 3040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:27.599591 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.590361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51948 (local address 127.1.206.65:33921)
0810 14:30:27.591672 (+ 1311us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.591678 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.591731 (+ 53us) server_negotiation.cc:407] Connection header received
0810 14:30:27.591891 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.591899 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.592207 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.593038 (+ 831us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:27.593266 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.594771 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.596952 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.598307 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.598573 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.598889 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.599166 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.599352 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1053,"thread_start_us":169,"threads_started":1}
I20260810 14:30:27.599586 3573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.589723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:33921 (local address 127.0.0.1:51948)
0810 14:30:27.590961 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.590995 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.591129 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.592518 (+ 1389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.592522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.592552 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:27.592775 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.592793 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.594947 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.594951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.596726 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.596737 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.598691 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.598696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.598870 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.598930 (+ 60us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.599099 (+ 169us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.599373 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1127,"mutex_wait_us":150,"thread_start_us":221,"threads_started":1}
I20260810 14:30:27.600981 3576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.588289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:43935 (local address 127.0.0.1:59192)
0810 14:30:27.590360 (+ 2071us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.590388 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.590565 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.591650 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.591659 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.591699 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:27.592049 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.592059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.594003 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.594015 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.596960 (+ 2945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.596969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.600019 (+ 3050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.600025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.600324 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.600473 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.600631 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.600770 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1967,"mutex_wait_us":373,"thread_start_us":184,"threads_started":1}
I20260810 14:30:27.601732 3577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.589732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.1.206.67:43935)
0810 14:30:27.590534 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.590566 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.590623 (+ 57us) server_negotiation.cc:407] Connection header received
0810 14:30:27.590778 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.590803 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.591211 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.592376 (+ 1165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:27.592638 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.593800 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.597141 (+ 3341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.598314 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.598573 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.598910 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.601306 (+ 2396us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.601490 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":222,"threads_started":1}
I20260810 14:30:27.604108 3574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.588146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:37059 (local address 127.0.0.1:58110)
0810 14:30:27.589551 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.589655 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.589929 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.592044 (+ 2115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.592049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.592080 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:27.592235 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.592316 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.594473 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.594477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.596956 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.596969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.603305 (+ 6336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.603311 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.603491 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.603545 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.603716 (+ 171us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.603875 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1052,"mutex_wait_us":229,"thread_start_us":219,"threads_started":1}
I20260810 14:30:27.604859 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.588368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58110 (local address 127.1.206.66:37059)
0810 14:30:27.590193 (+ 1825us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.590218 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.590268 (+ 50us) server_negotiation.cc:407] Connection header received
0810 14:30:27.590413 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.590424 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.591344 (+ 920us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.591701 (+ 357us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:27.592561 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.594261 (+ 1700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.599020 (+ 4759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.603055 (+ 4035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.603286 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.603573 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.604151 (+ 578us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.604649 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1660,"thread_start_us":433,"threads_started":1}
I20260810 14:30:27.605242 3188 tablet_service.cc:1467] Processing CreateTablet for tablet a4a4fb8a4efb47198db429a241a6a6ce (DEFAULT_TABLE table=test-table [id=3b46d93f5bfb4904a058d1c696e79356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:27.609560 3338 tablet_service.cc:1467] Processing CreateTablet for tablet a4a4fb8a4efb47198db429a241a6a6ce (DEFAULT_TABLE table=test-table [id=3b46d93f5bfb4904a058d1c696e79356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:27.610267 3485 tablet_service.cc:1467] Processing CreateTablet for tablet a4a4fb8a4efb47198db429a241a6a6ce (DEFAULT_TABLE table=test-table [id=3b46d93f5bfb4904a058d1c696e79356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:27.611577 3338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a4fb8a4efb47198db429a241a6a6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:27.611581 3188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a4fb8a4efb47198db429a241a6a6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:27.611996 3485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4a4fb8a4efb47198db429a241a6a6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:27.627820 3580 tablet_bootstrap.cc:492] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Bootstrap starting.
I20260810 14:30:27.628914 3579 tablet_bootstrap.cc:492] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Bootstrap starting.
I20260810 14:30:27.632946 3581 tablet_bootstrap.cc:492] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Bootstrap starting.
I20260810 14:30:27.633170 3579 tablet_bootstrap.cc:654] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:27.633050 3580 tablet_bootstrap.cc:654] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:27.634899 3579 log.cc:824] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:27.635310 3580 log.cc:824] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:27.637188 3581 tablet_bootstrap.cc:654] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:27.638624 3579 tablet_bootstrap.cc:492] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: No bootstrap required, opened a new log
I20260810 14:30:27.638732 3581 log.cc:824] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:27.639075 3579 ts_tablet_manager.cc:1397] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260810 14:30:27.639075 3580 tablet_bootstrap.cc:492] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: No bootstrap required, opened a new log
I20260810 14:30:27.639443 3580 ts_tablet_manager.cc:1397] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260810 14:30:27.643244 3581 tablet_bootstrap.cc:492] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: No bootstrap required, opened a new log
I20260810 14:30:27.643669 3581 ts_tablet_manager.cc:1397] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260810 14:30:27.646337 3580 raft_consensus.cc:348] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.646788 3580 raft_consensus.cc:374] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:27.646873 3580 raft_consensus.cc:729] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f93b08528145b5b163d11bdc048161, State: Initialized, Role: FOLLOWER
I20260810 14:30:27.647627 3580 consensus_queue.cc:260] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.647831 3579 raft_consensus.cc:348] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.648371 3579 raft_consensus.cc:374] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:27.648517 3579 raft_consensus.cc:729] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4f17015c5646e897ec0fb61f4362f8, State: Initialized, Role: FOLLOWER
I20260810 14:30:27.649451 3406 heartbeater.cc:503] Master 127.1.206.126:41327 was elected leader, sending a full tablet report...
I20260810 14:30:27.649916 3580 ts_tablet_manager.cc:1428] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
I20260810 14:30:27.650278 3579 consensus_queue.cc:260] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.650815 3581 raft_consensus.cc:348] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.651348 3581 raft_consensus.cc:374] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:27.651465 3581 raft_consensus.cc:729] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb305c104021456bb7827bd179006284, State: Initialized, Role: FOLLOWER
I20260810 14:30:27.651495 3259 heartbeater.cc:503] Master 127.1.206.126:41327 was elected leader, sending a full tablet report...
I20260810 14:30:27.652081 3579 ts_tablet_manager.cc:1428] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20260810 14:30:27.652305 3581 consensus_queue.cc:260] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.653715 3581 ts_tablet_manager.cc:1428] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
I20260810 14:30:27.653791 3554 heartbeater.cc:503] Master 127.1.206.126:41327 was elected leader, sending a full tablet report...
W20260810 14:30:27.662241 3407 tablet.cc:2369] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:27.670230 3586 raft_consensus.cc:482] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:27.670575 3586 raft_consensus.cc:504] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.674237 3586 leader_election.cc:288] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f93b08528145b5b163d11bdc048161 (127.1.206.66:37059), eb305c104021456bb7827bd179006284 (127.1.206.67:43935)
I20260810 14:30:27.680403 3577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.674770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:59069 (local address 127.1.206.67:43935)
0810 14:30:27.675044 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.675048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.675073 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:30:27.675148 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.675151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.675205 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.675380 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:27.675858 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.676830 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.678636 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.679260 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.679516 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.679622 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.679918 (+ 296us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.680068 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
W20260810 14:30:27.680526 3260 tablet.cc:2369] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:27.681010 3589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.673620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:37059 (local address 127.1.206.65:41759)
0810 14:30:27.675059 (+ 1439us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.675085 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.675310 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.675789 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.675803 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.675834 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:27.676111 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.676119 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.677314 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.677331 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.678887 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.678907 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.680009 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.680025 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.680243 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.680333 (+ 90us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.680538 (+ 205us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.680695 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1346,"mutex_wait_us":1,"thread_start_us":248,"threads_started":1}
I20260810 14:30:27.681432 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.674621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:41759 (local address 127.1.206.66:37059)
0810 14:30:27.674893 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.674899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.675220 (+ 321us) server_negotiation.cc:407] Connection header received
0810 14:30:27.675518 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.675524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.675592 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.675766 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:27.676342 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.677116 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.679154 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.679756 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.680050 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.680172 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.680958 (+ 786us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.681162 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260810 14:30:27.681762 3588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.673618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:43935 (local address 127.1.206.65:59069)
0810 14:30:27.674364 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:27.674409 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:27.674687 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:27.675403 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:27.675406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:27.675437 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:27.675647 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.675655 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.677014 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.677031 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.678369 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:27.678382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.679496 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.679501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:27.679688 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.679719 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 14:30:27.679895 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 14:30:27.680056 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":273,"threads_started":1}
I20260810 14:30:27.682566 3360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4a4fb8a4efb47198db429a241a6a6ce" candidate_uuid: "9a4f17015c5646e897ec0fb61f4362f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f93b08528145b5b163d11bdc048161" is_pre_election: true
I20260810 14:30:27.682899 3506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4a4fb8a4efb47198db429a241a6a6ce" candidate_uuid: "9a4f17015c5646e897ec0fb61f4362f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb305c104021456bb7827bd179006284" is_pre_election: true
I20260810 14:30:27.683168 3360 raft_consensus.cc:2454] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a4f17015c5646e897ec0fb61f4362f8 in term 0.
I20260810 14:30:27.683377 3506 raft_consensus.cc:2454] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a4f17015c5646e897ec0fb61f4362f8 in term 0.
I20260810 14:30:27.684250 3136 leader_election.cc:302] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f93b08528145b5b163d11bdc048161, 9a4f17015c5646e897ec0fb61f4362f8; no voters:
I20260810 14:30:27.684870 3586 raft_consensus.cc:2781] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:27.685083 3586 raft_consensus.cc:482] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:27.685155 3586 raft_consensus.cc:3037] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:27.687124 3586 raft_consensus.cc:504] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.687723 3586 leader_election.cc:288] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [CANDIDATE]: Term 1 election: Requested vote from peers 76f93b08528145b5b163d11bdc048161 (127.1.206.66:37059), eb305c104021456bb7827bd179006284 (127.1.206.67:43935)
I20260810 14:30:27.688560 3506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4a4fb8a4efb47198db429a241a6a6ce" candidate_uuid: "9a4f17015c5646e897ec0fb61f4362f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb305c104021456bb7827bd179006284"
I20260810 14:30:27.688560 3360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4a4fb8a4efb47198db429a241a6a6ce" candidate_uuid: "9a4f17015c5646e897ec0fb61f4362f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f93b08528145b5b163d11bdc048161"
I20260810 14:30:27.688838 3360 raft_consensus.cc:3037] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:27.688840 3506 raft_consensus.cc:3037] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:27.691606 3360 raft_consensus.cc:2454] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a4f17015c5646e897ec0fb61f4362f8 in term 1.
I20260810 14:30:27.692222 3506 raft_consensus.cc:2454] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a4f17015c5646e897ec0fb61f4362f8 in term 1.
I20260810 14:30:27.692343 3136 leader_election.cc:302] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f93b08528145b5b163d11bdc048161, 9a4f17015c5646e897ec0fb61f4362f8; no voters:
I20260810 14:30:27.692792 3586 raft_consensus.cc:2781] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:27.693311 3586 raft_consensus.cc:686] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 LEADER]: Becoming Leader. State: Replica: 9a4f17015c5646e897ec0fb61f4362f8, State: Running, Role: LEADER
I20260810 14:30:27.693745 3586 consensus_queue.cc:237] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } }
I20260810 14:30:27.699970 3039 catalog_manager.cc:5495] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65). New cstate: current_term: 1 leader_uuid: "9a4f17015c5646e897ec0fb61f4362f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } health_report { overall_health: HEALTHY } } }
I20260810 14:30:27.735857 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:27.728712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51950 (local address 127.1.206.65:33921)
0810 14:30:27.729003 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:27.729015 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:27.729042 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:30:27.729387 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:27.729396 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:27.729593 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:27.729765 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:27.730259 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.731237 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.732803 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:27.733168 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:27.733373 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:27.733992 (+ 619us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:27.734972 (+ 980us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:27.735209 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:27.735492 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 14:30:27.735607 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 14:30:27.747598 3360 raft_consensus.cc:1261] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Refusing update from remote peer 9a4f17015c5646e897ec0fb61f4362f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:27.748660 3506 raft_consensus.cc:1261] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Refusing update from remote peer 9a4f17015c5646e897ec0fb61f4362f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:27.749511 3591 consensus_queue.cc:1035] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:27.750000 3586 consensus_queue.cc:1035] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 14:30:27.755424 3556 tablet.cc:2369] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:27.764518 3594 mvcc.cc:205] Tried to move back new op lower bound from 7316980644836532224 to 7316980644638527488. Current Snapshot: MvccSnapshot[applied={T|T < 7316980644836532224}]
I20260810 14:30:27.767043 3598 mvcc.cc:205] Tried to move back new op lower bound from 7316980644836532224 to 7316980644638527488. Current Snapshot: MvccSnapshot[applied={T|T < 7316980644836532224}]
I20260810 14:30:27.768353 3595 mvcc.cc:205] Tried to move back new op lower bound from 7316980644836532224 to 7316980644638527488. Current Snapshot: MvccSnapshot[applied={T|T < 7316980644836532224}]
I20260810 14:30:27.789646 3041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:27.790073 3041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:27.795217 3041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: Sending DeleteTablet for 3 replicas of tablet a4a4fb8a4efb47198db429a241a6a6ce
I20260810 14:30:27.796773 3338 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a4fb8a4efb47198db429a241a6a6ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:27 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:58110
I20260810 14:30:27.797024 3188 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a4fb8a4efb47198db429a241a6a6ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:27 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:51948
I20260810 14:30:27.797639 3485 tablet_service.cc:1514] Processing DeleteTablet for tablet a4a4fb8a4efb47198db429a241a6a6ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:27 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:59192
I20260810 14:30:27.797802 3606 tablet_replica.cc:330] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: stopping tablet replica
I20260810 14:30:27.797799 3605 tablet_replica.cc:330] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: stopping tablet replica
I20260810 14:30:27.798411 3605 raft_consensus.cc:2229] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:27.798411 3606 raft_consensus.cc:2229] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:27.799024 3605 raft_consensus.cc:2258] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:27.799355 3606 raft_consensus.cc:2258] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:27.800338 3041 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:27.801077 3041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:27.801970 3605 ts_tablet_manager.cc:1905] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:27.802181 3606 ts_tablet_manager.cc:1905] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:27.805809 3607 tablet_replica.cc:330] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: stopping tablet replica
I20260810 14:30:27.806535 3607 raft_consensus.cc:2229] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:27.807147 3607 raft_consensus.cc:2258] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:27.807837 3605 ts_tablet_manager.cc:1918] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:27.808068 3605 log.cc:1196] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/a4a4fb8a4efb47198db429a241a6a6ce
I20260810 14:30:27.808810 3605 ts_tablet_manager.cc:1939] T a4a4fb8a4efb47198db429a241a6a6ce P 76f93b08528145b5b163d11bdc048161: Deleting consensus metadata
I20260810 14:30:27.811213 3024 catalog_manager.cc:4841] TS 76f93b08528145b5b163d11bdc048161 (127.1.206.66:37059): tablet a4a4fb8a4efb47198db429a241a6a6ce (table test-table [id=3b46d93f5bfb4904a058d1c696e79356]) successfully deleted
I20260810 14:30:27.811554 3606 ts_tablet_manager.cc:1918] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:27.811785 3606 log.cc:1196] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/a4a4fb8a4efb47198db429a241a6a6ce
I20260810 14:30:27.812541 3606 ts_tablet_manager.cc:1939] T a4a4fb8a4efb47198db429a241a6a6ce P 9a4f17015c5646e897ec0fb61f4362f8: Deleting consensus metadata
I20260810 14:30:27.812706 3338 tablet_service.cc:1467] Processing CreateTablet for tablet 4adc0a04775f4bb79b54391a798a2036 (DEFAULT_TABLE table=test-table [id=8f68c857ed52478ba41579ff1313cb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:27.813210 3338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adc0a04775f4bb79b54391a798a2036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:27.813572 3485 tablet_service.cc:1467] Processing CreateTablet for tablet 4adc0a04775f4bb79b54391a798a2036 (DEFAULT_TABLE table=test-table [id=8f68c857ed52478ba41579ff1313cb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:27.814095 3485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adc0a04775f4bb79b54391a798a2036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:27.815519 3607 ts_tablet_manager.cc:1905] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:27.812570 3188 tablet_service.cc:1467] Processing CreateTablet for tablet 4adc0a04775f4bb79b54391a798a2036 (DEFAULT_TABLE table=test-table [id=8f68c857ed52478ba41579ff1313cb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:27.817077 3188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adc0a04775f4bb79b54391a798a2036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:27.817559 3580 tablet_bootstrap.cc:492] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: Bootstrap starting.
I20260810 14:30:27.819408 3580 tablet_bootstrap.cc:654] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:27.821833 3026 catalog_manager.cc:4841] TS 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65:33921): tablet a4a4fb8a4efb47198db429a241a6a6ce (table test-table [id=3b46d93f5bfb4904a058d1c696e79356]) successfully deleted
I20260810 14:30:27.822265 3579 tablet_bootstrap.cc:492] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: Bootstrap starting.
I20260810 14:30:27.824172 3579 tablet_bootstrap.cc:654] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:27.824667 3581 tablet_bootstrap.cc:492] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: Bootstrap starting.
I20260810 14:30:27.824872 3607 ts_tablet_manager.cc:1918] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:27.825133 3607 log.cc:1196] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/a4a4fb8a4efb47198db429a241a6a6ce
I20260810 14:30:27.827571 3579 tablet_bootstrap.cc:492] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: No bootstrap required, opened a new log
I20260810 14:30:27.826453 3581 tablet_bootstrap.cc:654] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:27.827780 3579 ts_tablet_manager.cc:1397] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:30:27.828451 3580 tablet_bootstrap.cc:492] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: No bootstrap required, opened a new log
I20260810 14:30:27.828642 3580 ts_tablet_manager.cc:1397] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.004s
I20260810 14:30:27.828830 3579 raft_consensus.cc:348] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:27.825827 3607 ts_tablet_manager.cc:1939] T a4a4fb8a4efb47198db429a241a6a6ce P eb305c104021456bb7827bd179006284: Deleting consensus metadata
I20260810 14:30:27.829088 3579 raft_consensus.cc:374] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:27.829181 3579 raft_consensus.cc:729] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4f17015c5646e897ec0fb61f4362f8, State: Initialized, Role: FOLLOWER
I20260810 14:30:27.829491 3579 consensus_queue.cc:260] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:27.829545 3580 raft_consensus.cc:348] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:27.829751 3580 raft_consensus.cc:374] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:27.829833 3580 raft_consensus.cc:729] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f93b08528145b5b163d11bdc048161, State: Initialized, Role: FOLLOWER
I20260810 14:30:27.830058 3580 consensus_queue.cc:260] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:27.830598 3580 ts_tablet_manager.cc:1428] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:27.831579 3579 ts_tablet_manager.cc:1428] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260810 14:30:27.833654 3026 catalog_manager.cc:4841] TS eb305c104021456bb7827bd179006284 (127.1.206.67:43935): tablet a4a4fb8a4efb47198db429a241a6a6ce (table test-table [id=3b46d93f5bfb4904a058d1c696e79356]) successfully deleted
I20260810 14:30:27.835075 3581 tablet_bootstrap.cc:492] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: No bootstrap required, opened a new log
I20260810 14:30:27.835299 3581 ts_tablet_manager.cc:1397] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260810 14:30:27.836723 3581 raft_consensus.cc:348] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:27.836930 3581 raft_consensus.cc:374] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:27.837018 3581 raft_consensus.cc:729] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb305c104021456bb7827bd179006284, State: Initialized, Role: FOLLOWER
I20260810 14:30:27.837328 3581 consensus_queue.cc:260] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:27.837891 3581 ts_tablet_manager.cc:1428] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:28.070220 3587 raft_consensus.cc:482] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:28.070511 3587 raft_consensus.cc:504] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.073077 3587 leader_election.cc:288] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65:33921), 76f93b08528145b5b163d11bdc048161 (127.1.206.66:37059)
I20260810 14:30:28.080214 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.074538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:47205 (local address 127.1.206.66:37059)
0810 14:30:28.074825 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.074834 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.074863 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:30:28.075045 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.075049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.075148 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.075345 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:28.075811 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.076568 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.078280 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.078969 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.079256 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.079418 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.079827 (+ 409us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.079974 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260810 14:30:28.080214 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.073861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:57991 (local address 127.1.206.65:33921)
0810 14:30:28.074246 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.074261 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.074565 (+ 304us) server_negotiation.cc:407] Connection header received
0810 14:30:28.075121 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.075125 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.075222 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.075423 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:28.075911 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.076636 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.078279 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.078969 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.079259 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.079409 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.079825 (+ 416us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.079970 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260810 14:30:28.080305 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.073534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:33921 (local address 127.1.206.67:57991)
0810 14:30:28.074385 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.074415 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.074773 (+ 358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.075436 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.075446 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.075527 (+ 81us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:28.075713 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.075724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.076783 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.076787 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.078034 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.078053 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.079254 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.079260 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.079551 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.079595 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.079800 (+ 205us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.079997 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":154,"thread_start_us":244,"threads_started":1}
I20260810 14:30:28.080327 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.073663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:37059 (local address 127.1.206.67:47205)
0810 14:30:28.074608 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.074654 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.074774 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.075365 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.075370 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.075421 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:28.075645 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.075657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.076731 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.076739 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.078047 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.078062 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.079254 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.079259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.079577 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.079607 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.079777 (+ 170us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.080008 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"mutex_wait_us":157,"thread_start_us":212,"threads_started":1}
I20260810 14:30:28.081799 3360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc0a04775f4bb79b54391a798a2036" candidate_uuid: "eb305c104021456bb7827bd179006284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f93b08528145b5b163d11bdc048161" is_pre_election: true
I20260810 14:30:28.081769 3210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc0a04775f4bb79b54391a798a2036" candidate_uuid: "eb305c104021456bb7827bd179006284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4f17015c5646e897ec0fb61f4362f8" is_pre_election: true
I20260810 14:30:28.082060 3360 raft_consensus.cc:2454] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb305c104021456bb7827bd179006284 in term 0.
I20260810 14:30:28.082198 3210 raft_consensus.cc:2454] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb305c104021456bb7827bd179006284 in term 0.
I20260810 14:30:28.082887 3433 leader_election.cc:302] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f93b08528145b5b163d11bdc048161, eb305c104021456bb7827bd179006284; no voters:
I20260810 14:30:28.083400 3587 raft_consensus.cc:2781] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:28.083498 3587 raft_consensus.cc:482] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:28.083590 3587 raft_consensus.cc:3037] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:28.085353 3587 raft_consensus.cc:504] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.086002 3587 leader_election.cc:288] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [CANDIDATE]: Term 1 election: Requested vote from peers 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65:33921), 76f93b08528145b5b163d11bdc048161 (127.1.206.66:37059)
I20260810 14:30:28.086817 3360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc0a04775f4bb79b54391a798a2036" candidate_uuid: "eb305c104021456bb7827bd179006284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f93b08528145b5b163d11bdc048161"
I20260810 14:30:28.087013 3360 raft_consensus.cc:3037] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:28.088662 3360 raft_consensus.cc:2454] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb305c104021456bb7827bd179006284 in term 1.
I20260810 14:30:28.089152 3210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc0a04775f4bb79b54391a798a2036" candidate_uuid: "eb305c104021456bb7827bd179006284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4f17015c5646e897ec0fb61f4362f8"
I20260810 14:30:28.089236 3433 leader_election.cc:302] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f93b08528145b5b163d11bdc048161, eb305c104021456bb7827bd179006284; no voters:
I20260810 14:30:28.089385 3210 raft_consensus.cc:3037] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:28.089540 3587 raft_consensus.cc:2781] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:28.089915 3587 raft_consensus.cc:686] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 1 LEADER]: Becoming Leader. State: Replica: eb305c104021456bb7827bd179006284, State: Running, Role: LEADER
I20260810 14:30:28.090413 3587 consensus_queue.cc:237] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.091711 3210 raft_consensus.cc:2454] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb305c104021456bb7827bd179006284 in term 1.
I20260810 14:30:28.094777 3040 catalog_manager.cc:5495] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb305c104021456bb7827bd179006284 (127.1.206.67). New cstate: current_term: 1 leader_uuid: "eb305c104021456bb7827bd179006284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } health_report { overall_health: HEALTHY } } }
Aug 10 14:30:28 dist-test-slave-0b58 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372226, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:28.162253 3622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.147351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41327 (local address 127.0.0.1:54448)
0810 14:30:28.148119 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.148155 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.148417 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.148858 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.148861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.149818 (+ 957us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:28.149978 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.149988 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.150983 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.150999 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.151850 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.151868 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.152710 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.152714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.152854 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.153755 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:28.153772 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:28.156105 (+ 2333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:28.159185 (+ 3080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:28.159204 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:28.159212 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:28.159626 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:28.160371 (+ 745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:28.160375 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:28.160376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:28.160518 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:28.161434 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:28.161443 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:28.161586 (+ 143us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.161757 (+ 171us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.162041 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":273,"threads_started":1}
I20260810 14:30:28.162568 3623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.147442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54448 (local address 127.1.206.126:41327)
0810 14:30:28.148090 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.148113 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.148310 (+ 197us) server_negotiation.cc:407] Connection header received
0810 14:30:28.148577 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.148580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.148667 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.148810 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:28.150157 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.150749 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.152074 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.152503 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.152696 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.156457 (+ 3761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:28.156469 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:28.156471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:28.156507 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:28.158954 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:28.159872 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:28.159887 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:28.159889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:28.160089 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:28.160706 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:28.160710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:28.160712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:28.161199 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:28.161418 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.161892 (+ 474us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.162237 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":510,"thread_start_us":245,"threads_started":1}
I20260810 14:30:28.170034 3040 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:54448:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 14:30:28.171558 3040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:28.181734 3338 tablet_service.cc:1467] Processing CreateTablet for tablet a6d333e98316406e810da368db6f2891 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59a100b4734f41509d4bdeef2adc05c1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:30:28.181731 3188 tablet_service.cc:1467] Processing CreateTablet for tablet a6d333e98316406e810da368db6f2891 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59a100b4734f41509d4bdeef2adc05c1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:30:28.182518 3338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6d333e98316406e810da368db6f2891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:28.182510 3188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6d333e98316406e810da368db6f2891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:28.186702 3485 tablet_service.cc:1467] Processing CreateTablet for tablet a6d333e98316406e810da368db6f2891 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59a100b4734f41509d4bdeef2adc05c1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:30:28.187461 3485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6d333e98316406e810da368db6f2891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:28.188131 3579 tablet_bootstrap.cc:492] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: Bootstrap starting.
I20260810 14:30:28.189582 3580 tablet_bootstrap.cc:492] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: Bootstrap starting.
I20260810 14:30:28.190016 3579 tablet_bootstrap.cc:654] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:28.191339 3580 tablet_bootstrap.cc:654] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:28.192291 3579 tablet_bootstrap.cc:492] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: No bootstrap required, opened a new log
I20260810 14:30:28.192443 3579 ts_tablet_manager.cc:1397] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260810 14:30:28.193403 3579 raft_consensus.cc:348] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.193626 3579 raft_consensus.cc:374] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:28.193689 3580 tablet_bootstrap.cc:492] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: No bootstrap required, opened a new log
I20260810 14:30:28.193688 3581 tablet_bootstrap.cc:492] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: Bootstrap starting.
I20260810 14:30:28.193693 3579 raft_consensus.cc:729] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4f17015c5646e897ec0fb61f4362f8, State: Initialized, Role: FOLLOWER
I20260810 14:30:28.193841 3580 ts_tablet_manager.cc:1397] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 14:30:28.193936 3579 consensus_queue.cc:260] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.194448 3579 ts_tablet_manager.cc:1428] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260810 14:30:28.194499 3600 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.194811 3600 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:28.194785 3580 raft_consensus.cc:348] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.194962 3580 raft_consensus.cc:374] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:28.195014 3580 raft_consensus.cc:729] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f93b08528145b5b163d11bdc048161, State: Initialized, Role: FOLLOWER
I20260810 14:30:28.195174 3580 consensus_queue.cc:260] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.195405 3581 tablet_bootstrap.cc:654] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:28.195843 3580 ts_tablet_manager.cc:1428] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:28.195906 3585 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.196141 3585 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:28.198633 3581 tablet_bootstrap.cc:492] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: No bootstrap required, opened a new log
I20260810 14:30:28.198992 3581 ts_tablet_manager.cc:1397] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260810 14:30:28.199901 3581 raft_consensus.cc:348] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.200112 3581 raft_consensus.cc:374] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:28.200237 3581 raft_consensus.cc:729] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb305c104021456bb7827bd179006284, State: Initialized, Role: FOLLOWER
I20260810 14:30:28.200596 3581 consensus_queue.cc:260] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.201025 3587 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.201182 3581 ts_tablet_manager.cc:1428] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 14:30:28.201287 3587 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:28.273283 3585 raft_consensus.cc:482] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:28.273679 3585 raft_consensus.cc:504] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.275449 3585 leader_election.cc:288] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65:33921), eb305c104021456bb7827bd179006284 (127.1.206.67:43935)
I20260810 14:30:28.283135 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.276054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:40389 (local address 127.1.206.65:33921)
0810 14:30:28.276333 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.276341 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.276618 (+ 277us) server_negotiation.cc:407] Connection header received
0810 14:30:28.277024 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.277030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.277121 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.277318 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:28.277858 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.279093 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.281218 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.282230 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.282437 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.282513 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.282845 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.282958 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 14:30:28.283275 3627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.275847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:33921 (local address 127.1.206.66:40389)
0810 14:30:28.276418 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.276442 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.276794 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.277342 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.277345 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.277366 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:28.277613 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.277620 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.279363 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.279366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.280945 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.280963 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.282428 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.282434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.282631 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.282681 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.282822 (+ 141us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.282961 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"spinlock_wait_cycles":3456,"thread_start_us":166,"threads_started":1}
I20260810 14:30:28.284067 3210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d333e98316406e810da368db6f2891" candidate_uuid: "76f93b08528145b5b163d11bdc048161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4f17015c5646e897ec0fb61f4362f8" is_pre_election: true
I20260810 14:30:28.284407 3210 raft_consensus.cc:2454] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f93b08528145b5b163d11bdc048161 in term 0.
I20260810 14:30:28.284732 3628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.276543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:43935 (local address 127.1.206.66:44305)
0810 14:30:28.277224 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.277245 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.277456 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.277964 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.277967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.278009 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:28.278613 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.278623 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.280435 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.280444 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.282168 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.282181 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.283803 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.283807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.283995 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.284039 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.284221 (+ 182us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.284377 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"spinlock_wait_cycles":24704,"thread_start_us":160,"threads_started":1}
I20260810 14:30:28.284838 3629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.276783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:44305 (local address 127.1.206.67:43935)
0810 14:30:28.277115 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.277123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.277351 (+ 228us) server_negotiation.cc:407] Connection header received
0810 14:30:28.277663 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.277667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.277776 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.277955 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:28.278841 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.280072 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.282410 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.283388 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.283623 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.283765 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.284325 (+ 560us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.284517 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":98,"threads_started":1}
I20260810 14:30:28.285205 3288 leader_election.cc:302] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f93b08528145b5b163d11bdc048161, 9a4f17015c5646e897ec0fb61f4362f8; no voters:
I20260810 14:30:28.285637 3585 raft_consensus.cc:2781] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:28.285790 3585 raft_consensus.cc:482] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:28.285876 3585 raft_consensus.cc:3037] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:28.286064 3506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d333e98316406e810da368db6f2891" candidate_uuid: "76f93b08528145b5b163d11bdc048161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb305c104021456bb7827bd179006284" is_pre_election: true
I20260810 14:30:28.286330 3506 raft_consensus.cc:2454] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76f93b08528145b5b163d11bdc048161 in term 0.
I20260810 14:30:28.287596 3585 raft_consensus.cc:504] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.288467 3585 leader_election.cc:288] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [CANDIDATE]: Term 1 election: Requested vote from peers 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65:33921), eb305c104021456bb7827bd179006284 (127.1.206.67:43935)
I20260810 14:30:28.288913 3210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d333e98316406e810da368db6f2891" candidate_uuid: "76f93b08528145b5b163d11bdc048161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4f17015c5646e897ec0fb61f4362f8"
I20260810 14:30:28.288986 3506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6d333e98316406e810da368db6f2891" candidate_uuid: "76f93b08528145b5b163d11bdc048161" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb305c104021456bb7827bd179006284"
I20260810 14:30:28.289149 3210 raft_consensus.cc:3037] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:28.289156 3506 raft_consensus.cc:3037] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:28.291064 3506 raft_consensus.cc:2454] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f93b08528145b5b163d11bdc048161 in term 1.
I20260810 14:30:28.291064 3210 raft_consensus.cc:2454] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f93b08528145b5b163d11bdc048161 in term 1.
I20260810 14:30:28.291564 3288 leader_election.cc:302] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f93b08528145b5b163d11bdc048161, 9a4f17015c5646e897ec0fb61f4362f8; no voters:
I20260810 14:30:28.291785 3585 raft_consensus.cc:2781] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:28.292038 3585 raft_consensus.cc:686] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [term 1 LEADER]: Becoming Leader. State: Replica: 76f93b08528145b5b163d11bdc048161, State: Running, Role: LEADER
I20260810 14:30:28.292362 3585 consensus_queue.cc:237] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } }
I20260810 14:30:28.293964 3630 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: TxnStatusTablet state changed. Reason: New leader 76f93b08528145b5b163d11bdc048161. Latest consensus state: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.294126 3630 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:30:28.295102 3632 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 14:30:28.295333 3632 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 14:30:28.295660 3041 catalog_manager.cc:5495] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76f93b08528145b5b163d11bdc048161 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } health_report { overall_health: UNKNOWN } } }
I20260810 14:30:28.310475 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.305796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.1.206.66:37059)
0810 14:30:28.305943 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.305947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.306027 (+ 80us) server_negotiation.cc:407] Connection header received
0810 14:30:28.306333 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.306337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.306398 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.306489 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:28.306823 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.307397 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.308779 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.309018 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.309118 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.309513 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:28.309991 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:28.310088 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.310290 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.310353 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 14:30:28.310549 3622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.305657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:37059 (local address 127.0.0.1:58114)
0810 14:30:28.305942 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.305959 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.306111 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.306536 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.306539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.306548 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:28.306677 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.306685 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.307524 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.307528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.308631 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.308644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.309153 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.309157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.309263 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.309341 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:28.310099 (+ 758us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:28.310120 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.310211 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.310363 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165}
I20260810 14:30:28.314496 3506 raft_consensus.cc:1261] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Refusing update from remote peer 76f93b08528145b5b163d11bdc048161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:28.314641 3210 raft_consensus.cc:1261] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Refusing update from remote peer 76f93b08528145b5b163d11bdc048161: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:28.315096 3585 consensus_queue.cc:1035] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:28.315351 3630 consensus_queue.cc:1035] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:28.317204 3587 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: TxnStatusTablet state changed. Reason: New leader 76f93b08528145b5b163d11bdc048161. Latest consensus state: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.317353 3587 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:28.317328 3600 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: TxnStatusTablet state changed. Reason: New leader 76f93b08528145b5b163d11bdc048161. Latest consensus state: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.317469 3600 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:28.319505 3630 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.319671 3630 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:30:28.320427 3587 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.320550 3587 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P eb305c104021456bb7827bd179006284: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:28.321981 3630 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.322140 3630 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P 76f93b08528145b5b163d11bdc048161: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:30:28.323706 3600 tablet_replica.cc:439] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "76f93b08528145b5b163d11bdc048161" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 } } peers { permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 } } peers { permanent_uuid: "eb305c104021456bb7827bd179006284" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 43935 } } }
I20260810 14:30:28.323851 3600 tablet_replica.cc:442] T a6d333e98316406e810da368db6f2891 P 9a4f17015c5646e897ec0fb61f4362f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:28.335186 3629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.330343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59202 (local address 127.1.206.67:43935)
0810 14:30:28.330502 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.330507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.330794 (+ 287us) server_negotiation.cc:407] Connection header received
0810 14:30:28.330918 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.330920 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.330982 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.331075 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:28.331379 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.331931 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.333334 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.333658 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.333790 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.334191 (+ 401us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:28.334746 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:28.334912 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.334962 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.335026 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 14:30:28.348426 3649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.343940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:37059 (local address 127.1.206.67:49737)
0810 14:30:28.344371 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.344386 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.344597 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.344959 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.344962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.344971 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:28.345134 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.345140 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.346153 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.346158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.346889 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.346900 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.347462 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.347466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.347583 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.347640 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:28.348010 (+ 370us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:28.348018 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.348110 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.348211 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":118,"threads_started":1}
I20260810 14:30:28.348410 3575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.344070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:49737 (local address 127.1.206.66:37059)
0810 14:30:28.344245 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.344250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.344521 (+ 271us) server_negotiation.cc:407] Connection header received
0810 14:30:28.344721 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.344725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.344823 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.344946 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:28.345258 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.346010 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.347035 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.347316 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.347448 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.347803 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:28.347901 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:28.347991 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.348136 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.348201 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 14:30:28.357625 3360 raft_consensus.cc:1261] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Refusing update from remote peer eb305c104021456bb7827bd179006284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:28.358069 3210 raft_consensus.cc:1261] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Refusing update from remote peer eb305c104021456bb7827bd179006284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:28.358172 3587 consensus_queue.cc:1035] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f93b08528145b5b163d11bdc048161" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 37059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:28.358625 3587 consensus_queue.cc:1035] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a4f17015c5646e897ec0fb61f4362f8" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:28.388952 3629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.384628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:38899 (local address 127.1.206.67:43935)
0810 14:30:28.384779 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.384784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.385022 (+ 238us) server_negotiation.cc:407] Connection header received
0810 14:30:28.385149 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.385151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.385194 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.385258 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:28.385586 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.386308 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.387702 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.387952 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.388069 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.388425 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:28.388516 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:28.388599 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.388725 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.388784 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 14:30:28.388967 3657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.384560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:43935 (local address 127.1.206.66:38899)
0810 14:30:28.384925 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:28.384941 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:28.385063 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:28.385298 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:28.385301 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:28.385309 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:28.385463 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.385469 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.386674 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.386676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.387568 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:28.387579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.388074 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.388078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:28.388186 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.388239 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:28.388604 (+ 365us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:28.388614 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 14:30:28.388700 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 14:30:28.388789 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":137,"threads_started":1}
I20260810 14:30:28.414273 3040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:28.414448 3040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:28.416853 3040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6998691b74c84e5983dff484fb6d6642: Sending DeleteTablet for 3 replicas of tablet 4adc0a04775f4bb79b54391a798a2036
I20260810 14:30:28.417889 3188 tablet_service.cc:1514] Processing DeleteTablet for tablet 4adc0a04775f4bb79b54391a798a2036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:28 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:51948
I20260810 14:30:28.417928 3338 tablet_service.cc:1514] Processing DeleteTablet for tablet 4adc0a04775f4bb79b54391a798a2036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:28 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:58110
I20260810 14:30:28.418386 3485 tablet_service.cc:1514] Processing DeleteTablet for tablet 4adc0a04775f4bb79b54391a798a2036 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:28 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:59192
I20260810 14:30:28.418785 3663 tablet_replica.cc:330] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: stopping tablet replica
I20260810 14:30:28.418988 3663 raft_consensus.cc:2229] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:28.419386 3663 raft_consensus.cc:2258] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:28.421092 3663 ts_tablet_manager.cc:1905] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:28.424007 3663 ts_tablet_manager.cc:1918] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:28.424125 3663 log.cc:1196] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/4adc0a04775f4bb79b54391a798a2036
I20260810 14:30:28.424507 3662 tablet_replica.cc:330] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: stopping tablet replica
I20260810 14:30:28.424750 3663 ts_tablet_manager.cc:1939] T 4adc0a04775f4bb79b54391a798a2036 P eb305c104021456bb7827bd179006284: Deleting consensus metadata
I20260810 14:30:28.424750 3662 raft_consensus.cc:2229] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:28.425042 3662 raft_consensus.cc:2258] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:28.425493 3661 tablet_replica.cc:330] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: stopping tablet replica
I20260810 14:30:28.425711 3661 raft_consensus.cc:2229] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:28.425778 3026 catalog_manager.cc:4841] TS eb305c104021456bb7827bd179006284 (127.1.206.67:43935): tablet 4adc0a04775f4bb79b54391a798a2036 (table test-table [id=8f68c857ed52478ba41579ff1313cb0a]) successfully deleted
I20260810 14:30:28.425920 3662 ts_tablet_manager.cc:1905] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:28.425958 3661 raft_consensus.cc:2258] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:28.426743 3661 ts_tablet_manager.cc:1905] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:28.430161 3661 ts_tablet_manager.cc:1918] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:28.430289 3661 log.cc:1196] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/4adc0a04775f4bb79b54391a798a2036
I20260810 14:30:28.430644 3661 ts_tablet_manager.cc:1939] T 4adc0a04775f4bb79b54391a798a2036 P 76f93b08528145b5b163d11bdc048161: Deleting consensus metadata
I20260810 14:30:28.430634 3662 ts_tablet_manager.cc:1918] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:28.430739 3662 log.cc:1196] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/4adc0a04775f4bb79b54391a798a2036
I20260810 14:30:28.431061 3662 ts_tablet_manager.cc:1939] T 4adc0a04775f4bb79b54391a798a2036 P 9a4f17015c5646e897ec0fb61f4362f8: Deleting consensus metadata
I20260810 14:30:28.431603 3024 catalog_manager.cc:4841] TS 76f93b08528145b5b163d11bdc048161 (127.1.206.66:37059): tablet 4adc0a04775f4bb79b54391a798a2036 (table test-table [id=8f68c857ed52478ba41579ff1313cb0a]) successfully deleted
I20260810 14:30:28.431901 3026 catalog_manager.cc:4841] TS 9a4f17015c5646e897ec0fb61f4362f8 (127.1.206.65:33921): tablet 4adc0a04775f4bb79b54391a798a2036 (table test-table [id=8f68c857ed52478ba41579ff1313cb0a]) successfully deleted
Aug 10 14:30:28 dist-test-slave-0b58 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372227, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:28.445273 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.420462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51966 (local address 127.1.206.65:33921)
0810 14:30:28.420598 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.420604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.429734 (+ 9130us) server_negotiation.cc:407] Connection header received
0810 14:30:28.429980 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.429987 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.430050 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.430150 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:28.431717 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.432515 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.433946 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.434361 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.434476 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.439614 (+ 5138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:28.439638 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:28.439668 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:28.439724 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:28.442429 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:28.443146 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:28.443155 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:28.443159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:28.443288 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:28.443641 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:28.443645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:28.443646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:28.444024 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:28.444321 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.444736 (+ 415us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.444974 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 14:30:28.446473 3252 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51966
I20260810 14:30:28.459539 3623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:28.448877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.1.206.126:41327)
0810 14:30:28.449042 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:28.449047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:28.449202 (+ 155us) server_negotiation.cc:407] Connection header received
0810 14:30:28.449345 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:28.449349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:28.449409 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:28.449494 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:28.450405 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.451181 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.452473 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:28.452831 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:28.452962 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:28.454886 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:28.454891 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:28.454894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:28.454934 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:28.457103 (+ 2169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:28.457708 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:28.457712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:28.457714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:28.457837 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:28.458184 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:28.458188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:28.458190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:28.458622 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:28.458780 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:28.459168 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 14:30:28.459353 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 14:30:28.460697 3040 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54456
I20260810 14:30:28.462525 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 3119
I20260810 14:30:28.476119 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 3268
I20260810 14:30:28.489342 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 3415
I20260810 14:30:28.497103 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 3006
2026-08-10T14:30:28Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3330 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:28 dist-test-slave-0b58 krb5kdc[3670](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:28 dist-test-slave-0b58 krb5kdc[3670](info): set up 2 sockets
Aug 10 14:30:28 dist-test-slave-0b58 krb5kdc[3670](info): commencing operation
krb5kdc: starting...
W20260810 14:30:29.621901 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:29 dist-test-slave-0b58 krb5kdc[3670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:29.760564 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43131
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:43131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:29.885233 3683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:29.885555 3683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:29.885600 3683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:29.889961 3683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:29.890038 3683 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 14:30:29.890056 3683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:29.890075 3683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:29.890092 3683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:29.890143 3683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:29.895927 3683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:43131
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:29.897173 3683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:29.898303 3683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:29.907531 3691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:29.907531 3689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:29.907531 3688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:29.907647 3683 server_base.cc:1034] running on GCE node
I20260810 14:30:29.908609 3683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:29.909935 3683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:29.911135 3683 hybrid_clock.cc:648] HybridClock initialized: now 1786372229911114 us; error 39 us; skew 500 ppm
Aug 10 14:30:29 dist-test-slave-0b58 krb5kdc[3670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372229, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:29.914366 3683 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:29.915356 3683 webserver.cc:460] Webserver started at http://127.1.206.126:41869/ using document root <none> and password file <none>
I20260810 14:30:29.915941 3683 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:29.916008 3683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:29.916189 3683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:29.918672 3683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "bbee8ccdd95b49068a70d09465bb61a2"
format_stamp: "Formatted at 2026-08-10 14:30:29 on dist-test-slave-0b58"
server_key: "c47566a7e8faaad369d03962c8f0bb42"
server_key_iv: "56d4718dcf4ed81fb0952059dfac7a2e"
server_key_version: "encryptionkey@0"
I20260810 14:30:29.919275 3683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "bbee8ccdd95b49068a70d09465bb61a2"
format_stamp: "Formatted at 2026-08-10 14:30:29 on dist-test-slave-0b58"
server_key: "c47566a7e8faaad369d03962c8f0bb42"
server_key_iv: "56d4718dcf4ed81fb0952059dfac7a2e"
server_key_version: "encryptionkey@0"
I20260810 14:30:29.923887 3683 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:29.926929 3699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:29.928709 3683 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:29.928896 3683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "bbee8ccdd95b49068a70d09465bb61a2"
format_stamp: "Formatted at 2026-08-10 14:30:29 on dist-test-slave-0b58"
server_key: "c47566a7e8faaad369d03962c8f0bb42"
server_key_iv: "56d4718dcf4ed81fb0952059dfac7a2e"
server_key_version: "encryptionkey@0"
I20260810 14:30:29.929044 3683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:29.950959 3683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:29.954856 3683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:29.955107 3683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:29.963963 3683 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:43131
I20260810 14:30:29.963980 3764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:43131 every 8 connection(s)
I20260810 14:30:29.965310 3683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:29.968567 3765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:29.969396 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 3683
I20260810 14:30:29.969552 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:29.969838 1849 external_mini_cluster.cc:1428] Setting key ee5f4c8dc2d080f943fa1348e2da9168
I20260810 14:30:29.975934 3765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Bootstrap starting.
I20260810 14:30:29.979389 3765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:29.980561 3765 log.cc:824] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:30:29 dist-test-slave-0b58 krb5kdc[3670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372229, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:29.983021 3765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: No bootstrap required, opened a new log
I20260810 14:30:29.987828 3765 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbee8ccdd95b49068a70d09465bb61a2" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43131 } }
I20260810 14:30:29.988168 3765 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:29.988220 3765 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbee8ccdd95b49068a70d09465bb61a2, State: Initialized, Role: FOLLOWER
I20260810 14:30:29.988785 3765 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbee8ccdd95b49068a70d09465bb61a2" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43131 } }
I20260810 14:30:29.988961 3765 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:29.989024 3765 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:29.989087 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:29.971767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54998 (local address 127.1.206.126:43131)
0810 14:30:29.972344 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:29.972363 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:29.972404 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:30:29.973109 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:29.973131 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:29.973538 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:29.973874 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:29.974949 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:29.976313 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:29.977737 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:29.978327 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:29.978475 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:29.981971 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:29.981977 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:29.981994 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:29.982023 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:29.985144 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:29.985702 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:29.985709 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:29.985717 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:29.985895 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:29.986354 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:29.986358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:29.986360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:29.987008 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:29.987279 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:29.987601 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 14:30:29.987957 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":171,"threads_started":1}
I20260810 14:30:29.989132 3765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:29.990486 3765 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbee8ccdd95b49068a70d09465bb61a2" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43131 } }
I20260810 14:30:29.990868 3765 leader_election.cc:302] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbee8ccdd95b49068a70d09465bb61a2; no voters:
I20260810 14:30:29.991231 3765 leader_election.cc:288] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:29.991370 3770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:29.991645 3770 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [term 1 LEADER]: Becoming Leader. State: Replica: bbee8ccdd95b49068a70d09465bb61a2, State: Running, Role: LEADER
I20260810 14:30:29.991973 3770 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbee8ccdd95b49068a70d09465bb61a2" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43131 } }
I20260810 14:30:29.992715 3765 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:29.993993 3771 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbee8ccdd95b49068a70d09465bb61a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbee8ccdd95b49068a70d09465bb61a2" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43131 } } }
I20260810 14:30:29.994179 3771 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:29.993993 3773 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbee8ccdd95b49068a70d09465bb61a2. Latest consensus state: current_term: 1 leader_uuid: "bbee8ccdd95b49068a70d09465bb61a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbee8ccdd95b49068a70d09465bb61a2" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43131 } } }
I20260810 14:30:29.994289 3773 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:29.994655 3781 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:29.997758 3781 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:30.004024 3781 catalog_manager.cc:1347] Generated new cluster ID: 1497bc10f26845c7a6203fc819ef279a
I20260810 14:30:30.004134 3781 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:30.049080 3781 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:30.050184 3781 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:30.061797 3781 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Generated new TSK 0
I20260810 14:30:30.062664 3781 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:30.099504 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43131
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:30.221670 3794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:30.221987 3794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:30.222038 3794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:30.229725 3794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:30.229826 3794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:30.229936 3794 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 14:30:30.229969 3794 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:30:30.230062 3794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:30.236143 3794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:30.237447 3794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:30.238533 3794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:30.249199 3803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:30.249215 3799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:30.249275 3794 server_base.cc:1034] running on GCE node
W20260810 14:30:30.249199 3800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:30.249958 3794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:30.250801 3794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:30.251991 3794 hybrid_clock.cc:648] HybridClock initialized: now 1786372230251972 us; error 29 us; skew 500 ppm
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:30.255002 3794 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:30.255959 3794 webserver.cc:460] Webserver started at http://127.1.206.65:42459/ using document root <none> and password file <none>
I20260810 14:30:30.256634 3794 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:30.256704 3794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:30.256978 3794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:30.259176 3794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "ecfe593e322e4060a228236b7724557b"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "41b7c7088bd807395b7dbc0857018ce3"
server_key_iv: "319f03e1b77c3387433239b7c51a4e5f"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.259805 3794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "ecfe593e322e4060a228236b7724557b"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "41b7c7088bd807395b7dbc0857018ce3"
server_key_iv: "319f03e1b77c3387433239b7c51a4e5f"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.264025 3794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260810 14:30:30.267074 3810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:30.268850 3794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:30.269145 3794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "ecfe593e322e4060a228236b7724557b"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "41b7c7088bd807395b7dbc0857018ce3"
server_key_iv: "319f03e1b77c3387433239b7c51a4e5f"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.269332 3794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:30.291805 3794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:30.295711 3794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:30.295958 3794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:30.298060 3794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:30.298142 3794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:30.298214 3794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:30.298249 3794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:30.310148 3794 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:45833
I20260810 14:30:30.310308 3932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:45833 every 8 connection(s)
I20260810 14:30:30.311417 3794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:30.313949 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.298890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:58885 (local address 127.1.206.126:43131)
0810 14:30:30.299017 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.299021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.300305 (+ 1284us) server_negotiation.cc:407] Connection header received
0810 14:30:30.301631 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.301636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.301709 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.301834 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:30.303438 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.304363 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.305690 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.305975 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.306124 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.309432 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:30.309439 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:30.309445 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:30.309483 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:30.311544 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.312233 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.312237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.312239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.312407 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.312794 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.312796 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.312797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.313003 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:30.313089 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.313678 (+ 589us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.313817 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:30:30.314816 3819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.299485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43131 (local address 127.1.206.65:58885)
0810 14:30:30.300074 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.300155 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.301271 (+ 1116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.302041 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.302048 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.302543 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:30.303262 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.303281 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.304519 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.304523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.305537 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.305548 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.306189 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.306194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.306398 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.307157 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:30.307176 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:30.309197 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:30.311717 (+ 2520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.311722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.311735 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.312091 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.312536 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.312539 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.312541 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.312689 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.313131 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:30.313137 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:30.313423 (+ 286us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.313594 (+ 171us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.313877 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":170,"threads_started":1}
I20260810 14:30:30.316442 3934 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43131
I20260810 14:30:30.316609 3934 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:30.317221 3934 heartbeater.cc:511] Master 127.1.206.126:43131 requested a full tablet report, sending...
I20260810 14:30:30.318236 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 3794
I20260810 14:30:30.318408 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:30.318732 1849 external_mini_cluster.cc:1428] Setting key 6b9ded22a1f22d13715796227d2ba6c9
I20260810 14:30:30.319120 3715 ts_manager.cc:194] Registered new tserver with Master: ecfe593e322e4060a228236b7724557b (127.1.206.65:45833)
I20260810 14:30:30.320546 3715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:58885
I20260810 14:30:30.329855 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.319368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:51433 (local address 127.1.206.126:43131)
0810 14:30:30.319506 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.319510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.321565 (+ 2055us) server_negotiation.cc:407] Connection header received
0810 14:30:30.321789 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.321795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.321856 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.321919 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:30.322806 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.323559 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.324502 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.324745 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.324854 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.326306 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:30.326310 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:30.326312 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:30.326336 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:30.327931 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.328541 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.328544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.328545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.328631 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.328967 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.328970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.328971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.329161 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:30.329239 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.329596 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.329716 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:30:30.329953 3940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.319124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43131 (local address 127.1.206.65:51433)
0810 14:30:30.321470 (+ 2346us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.321489 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.321657 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.322099 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.322103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.322402 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:30.322646 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.322658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.323712 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.323716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.324358 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.324367 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.324880 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.324886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.325026 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.325577 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:30.325598 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:30.326148 (+ 550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:30.328060 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.328067 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.328070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.328421 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.328735 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.328740 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.328742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.328861 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.329268 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:30.329273 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:30.329400 (+ 127us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.329527 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.329722 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2223,"mutex_wait_us":2,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:30.352200 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43131
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:30.474799 3944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:30.475183 3944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:30.475244 3944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:30.479984 3944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:30.480077 3944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:30.480123 3944 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 14:30:30.480139 3944 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:30:30.480176 3944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:30.486342 3944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:30.487540 3944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:30.488718 3944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:30.499538 3949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:30.499523 3952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:30.499569 3950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:30.499866 3944 server_base.cc:1034] running on GCE node
I20260810 14:30:30.500569 3944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:30.501351 3944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:30.502550 3944 hybrid_clock.cc:648] HybridClock initialized: now 1786372230502534 us; error 30 us; skew 500 ppm
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:30.505884 3944 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:30.507445 3944 webserver.cc:460] Webserver started at http://127.1.206.66:33629/ using document root <none> and password file <none>
I20260810 14:30:30.508117 3944 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:30.508242 3944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:30.508671 3944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:30.511058 3944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "68ed1d4d68c34ef0a0892ebe3e243159"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "9738505250caa6981c0f4383ecdddea6"
server_key_iv: "59ca50faaf5a00849ac70360eb3e2dd7"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.511751 3944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "68ed1d4d68c34ef0a0892ebe3e243159"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "9738505250caa6981c0f4383ecdddea6"
server_key_iv: "59ca50faaf5a00849ac70360eb3e2dd7"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.516584 3944 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260810 14:30:30.519490 3961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:30.521139 3944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:30.521313 3944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "68ed1d4d68c34ef0a0892ebe3e243159"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "9738505250caa6981c0f4383ecdddea6"
server_key_iv: "59ca50faaf5a00849ac70360eb3e2dd7"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.521454 3944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:30.536707 3944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:30.540882 3944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:30.541167 3944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:30.543102 3944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:30.543191 3944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:30.543270 3944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:30.543326 3944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:30.555341 3944 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:46207
I20260810 14:30:30.555490 4083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:46207 every 8 connection(s)
I20260810 14:30:30.556496 3944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:30.560734 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 3944
I20260810 14:30:30.560883 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:30.561120 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.544028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:39383 (local address 127.1.206.126:43131)
0810 14:30:30.544234 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.544239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.545827 (+ 1588us) server_negotiation.cc:407] Connection header received
0810 14:30:30.547105 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.547109 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.547181 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.547306 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:30.549356 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.550018 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.551562 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.551965 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.552101 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.556069 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:30.556073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:30.556075 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:30.556107 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:30.558111 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.558783 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.558787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.558788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.558891 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.559413 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.559417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.559418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.559670 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:30.559909 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.560760 (+ 851us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.560941 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 14:30:30.561208 1849 external_mini_cluster.cc:1428] Setting key bd127a787ae08cb2362569a9c6f7f48c
I20260810 14:30:30.562271 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.545093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43131 (local address 127.1.206.66:39383)
0810 14:30:30.545631 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.545693 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.546842 (+ 1149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.547529 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.547538 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.548169 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:30.549085 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.549133 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.550227 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.550231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.551383 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.551397 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.552169 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.552173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.552486 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.553269 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:30.553297 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:30.555814 (+ 2517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:30.558245 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.558252 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.558265 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.558598 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.559056 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.559058 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.559060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.559248 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.559944 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:30.559951 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:30.560343 (+ 392us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.560618 (+ 275us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.560951 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":144,"threads_started":1}
I20260810 14:30:30.563890 4084 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43131
I20260810 14:30:30.564080 4084 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:30.564872 4084 heartbeater.cc:511] Master 127.1.206.126:43131 requested a full tablet report, sending...
I20260810 14:30:30.566675 3715 ts_manager.cc:194] Registered new tserver with Master: 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207)
I20260810 14:30:30.567538 3715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:39383
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:30.578269 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.567037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:44277 (local address 127.1.206.126:43131)
0810 14:30:30.567202 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.567207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.567429 (+ 222us) server_negotiation.cc:407] Connection header received
0810 14:30:30.567547 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.567552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.567612 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.567705 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:30.568552 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.569436 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.571470 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.571737 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.571841 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.573554 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:30.573558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:30.573562 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:30.573601 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:30.575522 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.576631 (+ 1109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.576635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.576636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.576754 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.577160 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.577164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.577168 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.577467 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:30.577602 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.577942 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.578081 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 14:30:30.578284 4092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.566982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43131 (local address 127.1.206.66:44277)
0810 14:30:30.567322 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.567339 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.567456 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.567855 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.567861 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.568152 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:30.568387 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.568400 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.569631 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.569635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.571107 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.571128 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.571900 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.571906 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.572051 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.572739 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:30.572763 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:30.573312 (+ 549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:30.575698 (+ 2386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.575705 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.575710 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.576001 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.576922 (+ 921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.576925 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.576927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.577035 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.577591 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:30.577595 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:30.577714 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.577858 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.578082 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":138,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:30.601022 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43131
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:30.735669 4094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:30.736022 4094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:30.736110 4094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:30.740568 4094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:30.740681 4094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:30.740758 4094 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 14:30:30.740805 4094 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:30:30.740880 4094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:30.746893 4094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:43131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:30.748191 4094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:30.749440 4094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:30:30.760561 4094 server_base.cc:1034] running on GCE node
W20260810 14:30:30.760509 4100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:30.760864 4102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:30.760910 4099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:30.761559 4094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:30.762549 4094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:30.763751 4094 hybrid_clock.cc:648] HybridClock initialized: now 1786372230763732 us; error 40 us; skew 500 ppm
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:30.767510 4094 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:30.768702 4094 webserver.cc:460] Webserver started at http://127.1.206.67:39899/ using document root <none> and password file <none>
I20260810 14:30:30.769400 4094 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:30.769515 4094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:30.769795 4094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:30.772239 4094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "aedd9abe03684947bee6a2c9cd1112d2"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "f75365a37c5bbf39c833f5f4ad6669da"
server_key_iv: "315e85f2bfe67d4e935eb5fa158a81d0"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.773030 4094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "aedd9abe03684947bee6a2c9cd1112d2"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "f75365a37c5bbf39c833f5f4ad6669da"
server_key_iv: "315e85f2bfe67d4e935eb5fa158a81d0"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.777626 4094 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260810 14:30:30.780783 4109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:30.782341 4094 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:30:30.782524 4094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "aedd9abe03684947bee6a2c9cd1112d2"
format_stamp: "Formatted at 2026-08-10 14:30:30 on dist-test-slave-0b58"
server_key: "f75365a37c5bbf39c833f5f4ad6669da"
server_key_iv: "315e85f2bfe67d4e935eb5fa158a81d0"
server_key_version: "encryptionkey@0"
I20260810 14:30:30.782675 4094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:30.812001 4094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:30.815935 4094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:30.816227 4094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:30.818055 4094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:30.818136 4094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:30.818215 4094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:30.818259 4094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:30.831040 4094 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:46257
I20260810 14:30:30.831174 4234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:46257 every 8 connection(s)
I20260810 14:30:30.832381 4094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:30.835521 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.819239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:49253 (local address 127.1.206.126:43131)
0810 14:30:30.819428 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.819432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.820848 (+ 1416us) server_negotiation.cc:407] Connection header received
0810 14:30:30.822425 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.822429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.822499 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.822615 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:30.824716 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.825706 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.827284 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.827691 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.827832 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.831249 (+ 3417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:30.831254 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:30.831257 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:30.831291 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:30.833236 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.833998 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.834002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.834003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.834104 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.834435 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.834438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.834439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.834657 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:30.834743 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.835256 (+ 513us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.835386 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260810 14:30:30.836551 4120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.819987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43131 (local address 127.1.206.67:49253)
0810 14:30:30.820639 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.820692 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.822070 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.822900 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.822913 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.823625 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:30.824527 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.824549 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.825881 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.825884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.827124 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.827136 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.827897 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.827901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.828080 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.828966 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:30.828985 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:30.830980 (+ 1995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:30.833422 (+ 2442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.833427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.833467 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.833862 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.834178 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.834180 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.834182 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.834314 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.834761 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:30.834766 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:30.835019 (+ 253us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.835177 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.835495 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":202,"threads_started":1}
I20260810 14:30:30.838104 4235 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43131
I20260810 14:30:30.838297 4235 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:30.838954 4235 heartbeater.cc:511] Master 127.1.206.126:43131 requested a full tablet report, sending...
I20260810 14:30:30.840286 3715 ts_manager.cc:194] Registered new tserver with Master: aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257)
I20260810 14:30:30.840519 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 4094
I20260810 14:30:30.840651 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:30.841020 1849 external_mini_cluster.cc:1428] Setting key dd794f8956719513e219dfde874c43f0
I20260810 14:30:30.841147 3715 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:49253
I20260810 14:30:30.843942 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:30:30.850222 4241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.840620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43131 (local address 127.1.206.67:39813)
0810 14:30:30.840939 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.840955 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.841048 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.841790 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.841793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.842089 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:30.842228 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.842237 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.843238 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.843242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.844040 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.844076 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.844708 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.844711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.844821 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.845471 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:30.845485 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:30.845893 (+ 408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:30.848379 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.848382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.848384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.848656 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.849035 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:30.849037 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:30.849039 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:30.849132 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:30.849720 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:30.849723 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:30.849820 (+ 97us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.849919 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.850058 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":153,"threads_started":1}
I20260810 14:30:30.850659 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.840594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:39813 (local address 127.1.206.126:43131)
0810 14:30:30.841508 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.841516 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.841534 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:30:30.841579 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.841585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.841652 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.841755 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:30.842373 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.843089 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.844197 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.844570 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.844683 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.846063 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:30.846068 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:30.846070 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:30.846120 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:30.848135 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.848788 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.848796 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.848801 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.848920 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.849237 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.849244 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.849249 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.849556 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:30.849682 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.850036 (+ 354us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.850215 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":796}
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:30:30 dist-test-slave-0b58 krb5kdc[3670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372230, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:30.877189 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.867087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45072 (local address 127.1.206.126:43131)
0810 14:30:30.867318 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.867322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.867339 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:30:30.867385 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.867388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.867429 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.867560 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:30.868442 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.868992 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.869916 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.870155 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.870288 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.873351 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:30.873355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:30.873357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:30.873397 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:30.875206 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.875769 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.875792 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.875794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.875901 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:30.876188 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:30.876191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:30.876192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:30.876543 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:30.876671 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.876922 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.877049 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260810 14:30:30.880820 3715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:30.884047 3715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:30.900657 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.894477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46724 (local address 127.1.206.67:46257)
0810 14:30:30.894983 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.894996 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.895371 (+ 375us) server_negotiation.cc:407] Connection header received
0810 14:30:30.895465 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.895471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.895705 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.895863 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:30.896440 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.897308 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.898824 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.899832 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.899945 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.900123 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.900365 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.900485 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":142,"threads_started":1}
I20260810 14:30:30.900729 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.894351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45833 (local address 127.0.0.1:43766)
0810 14:30:30.894797 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.894865 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.895011 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.896638 (+ 1627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.896641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.896657 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:30.896748 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.896755 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.898214 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.898217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.899258 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.899267 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.900223 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.900228 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.900354 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.900376 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.900421 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.900538 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":100,"thread_start_us":99,"threads_started":1}
I20260810 14:30:30.900729 4253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.894351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:46257 (local address 127.0.0.1:46724)
0810 14:30:30.895123 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.895138 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.895244 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.896071 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.896078 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.896103 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:30.896292 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.896300 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.897432 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.897438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.898644 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.898655 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.899977 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.899981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.900098 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.900164 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.900325 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.900538 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":30,"thread_start_us":112,"threads_started":1}
I20260810 14:30:30.901434 4256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.895177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46207 (local address 127.0.0.1:42266)
0810 14:30:30.895496 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.895509 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.895588 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.896324 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.896327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.896348 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:30.896459 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.896466 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.898054 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.898058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.899281 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.899292 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.900932 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.900938 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.901016 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.901036 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.901134 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.901307 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":61,"thread_start_us":104,"threads_started":1}
I20260810 14:30:30.901445 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.895362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42266 (local address 127.1.206.66:46207)
0810 14:30:30.895800 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.895816 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.895852 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:30:30.895929 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.895936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.896128 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.896608 (+ 480us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:30.896749 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.897916 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.899423 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.900428 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.900532 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.900679 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.901171 (+ 492us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.901292 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":123,"threads_started":1}
I20260810 14:30:30.901729 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.895440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43766 (local address 127.1.206.65:45833)
0810 14:30:30.896158 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.896165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.896192 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:30:30.896295 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.896301 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.896479 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.896905 (+ 426us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:30.897046 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.898089 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.899401 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.900082 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.901174 (+ 1092us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.901340 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.901396 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.901516 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":74,"threads_started":1}
I20260810 14:30:30.904450 4013 tablet_service.cc:1467] Processing CreateTablet for tablet 723f8377017f4883bac6168b9c55d96d (DEFAULT_TABLE table=test-table [id=3f3dd133235946c2ac48ecf9a0c02e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:30.904501 4163 tablet_service.cc:1467] Processing CreateTablet for tablet 723f8377017f4883bac6168b9c55d96d (DEFAULT_TABLE table=test-table [id=3f3dd133235946c2ac48ecf9a0c02e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:30.904501 3861 tablet_service.cc:1467] Processing CreateTablet for tablet 723f8377017f4883bac6168b9c55d96d (DEFAULT_TABLE table=test-table [id=3f3dd133235946c2ac48ecf9a0c02e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:30.905580 4013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723f8377017f4883bac6168b9c55d96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:30.905598 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723f8377017f4883bac6168b9c55d96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:30.905606 4163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 723f8377017f4883bac6168b9c55d96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:30.913385 4259 tablet_bootstrap.cc:492] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Bootstrap starting.
I20260810 14:30:30.914753 4260 tablet_bootstrap.cc:492] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Bootstrap starting.
I20260810 14:30:30.915000 4261 tablet_bootstrap.cc:492] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Bootstrap starting.
I20260810 14:30:30.916020 4259 tablet_bootstrap.cc:654] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:30.917179 4259 log.cc:824] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:30.917255 4261 tablet_bootstrap.cc:654] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:30.917255 4260 tablet_bootstrap.cc:654] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:30.918201 4260 log.cc:824] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:30.918201 4261 log.cc:824] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:30.919736 4259 tablet_bootstrap.cc:492] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: No bootstrap required, opened a new log
I20260810 14:30:30.919986 4259 ts_tablet_manager.cc:1397] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260810 14:30:30.920362 4260 tablet_bootstrap.cc:492] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: No bootstrap required, opened a new log
I20260810 14:30:30.920357 4261 tablet_bootstrap.cc:492] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: No bootstrap required, opened a new log
I20260810 14:30:30.920554 4261 ts_tablet_manager.cc:1397] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260810 14:30:30.920554 4260 ts_tablet_manager.cc:1397] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:30:30.923434 4259 raft_consensus.cc:348] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:30.924104 4259 raft_consensus.cc:374] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:30.924173 4259 raft_consensus.cc:729] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Initialized, Role: FOLLOWER
I20260810 14:30:30.924993 4259 consensus_queue.cc:260] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:30.925396 4261 raft_consensus.cc:348] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:30.925529 4260 raft_consensus.cc:348] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:30.925716 4261 raft_consensus.cc:374] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:30.925765 4260 raft_consensus.cc:374] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:30.925779 4261 raft_consensus.cc:729] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedd9abe03684947bee6a2c9cd1112d2, State: Initialized, Role: FOLLOWER
I20260810 14:30:30.925834 4260 raft_consensus.cc:729] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfe593e322e4060a228236b7724557b, State: Initialized, Role: FOLLOWER
I20260810 14:30:30.926230 4084 heartbeater.cc:503] Master 127.1.206.126:43131 was elected leader, sending a full tablet report...
I20260810 14:30:30.926292 4261 consensus_queue.cc:260] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:30.926292 4260 consensus_queue.cc:260] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:30.926533 4259 ts_tablet_manager.cc:1428] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260810 14:30:30.927188 4235 heartbeater.cc:503] Master 127.1.206.126:43131 was elected leader, sending a full tablet report...
I20260810 14:30:30.927377 4260 ts_tablet_manager.cc:1428] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260810 14:30:30.927372 4261 ts_tablet_manager.cc:1428] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260810 14:30:30.927795 3934 heartbeater.cc:503] Master 127.1.206.126:43131 was elected leader, sending a full tablet report...
I20260810 14:30:30.993366 4265 raft_consensus.cc:482] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:30.993620 4265 raft_consensus.cc:504] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:30.995054 4265 leader_election.cc:288] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257), ecfe593e322e4060a228236b7724557b (127.1.206.65:45833)
I20260810 14:30:31.000031 4268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.995423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:46257 (local address 127.1.206.66:38597)
0810 14:30:30.995922 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.995955 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.996047 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.996313 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.996318 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.996341 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:30.996531 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.996542 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.997649 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.997652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.998555 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.998565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.999513 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.999517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.999638 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.999673 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 14:30:30.999778 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 14:30:30.999860 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":133,"thread_start_us":154,"threads_started":1}
I20260810 14:30:31.000011 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.995508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:38597 (local address 127.1.206.67:46257)
0810 14:30:30.995685 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.995690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.996064 (+ 374us) server_negotiation.cc:407] Connection header received
0810 14:30:30.996132 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.996135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.996174 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.996242 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:30.996658 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.997518 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.998713 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.999377 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.999509 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:30.999571 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:30.999800 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 14:30:30.999880 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:30:31.000684 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.995416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45833 (local address 127.1.206.66:41411)
0810 14:30:30.995558 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:30.995578 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:30.995688 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:30.995999 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:30.996003 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:30.996024 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:30.996196 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.996203 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.997544 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.997550 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:30.999117 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:30.999128 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.000332 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.000337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.000444 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.000464 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.000523 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.000584 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"spinlock_wait_cycles":1408}
I20260810 14:30:31.000810 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:30.995514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:41411 (local address 127.1.206.65:45833)
0810 14:30:30.995667 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:30.995673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:30.995707 (+ 34us) server_negotiation.cc:407] Connection header received
0810 14:30:30.995804 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:30.995807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:30.995869 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:30.995952 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:30.996445 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.997391 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:30.999292 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:30.999905 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.000027 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.000081 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.000584 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.000678 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 14:30:31.000820 4184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723f8377017f4883bac6168b9c55d96d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2" is_pre_election: true
I20260810 14:30:31.001216 4184 raft_consensus.cc:2454] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 0.
I20260810 14:30:31.001499 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723f8377017f4883bac6168b9c55d96d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b" is_pre_election: true
I20260810 14:30:31.001789 3884 raft_consensus.cc:2454] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 0.
I20260810 14:30:31.001798 3962 leader_election.cc:302] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ed1d4d68c34ef0a0892ebe3e243159, aedd9abe03684947bee6a2c9cd1112d2; no voters:
I20260810 14:30:31.002133 4265 raft_consensus.cc:2781] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:31.002249 4265 raft_consensus.cc:482] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:31.002300 4265 raft_consensus.cc:3037] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.003448 4265 raft_consensus.cc:504] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:31.003820 4265 leader_election.cc:288] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 election: Requested vote from peers aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257), ecfe593e322e4060a228236b7724557b (127.1.206.65:45833)
I20260810 14:30:31.004221 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723f8377017f4883bac6168b9c55d96d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b"
I20260810 14:30:31.004299 4184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "723f8377017f4883bac6168b9c55d96d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2"
I20260810 14:30:31.004420 3884 raft_consensus.cc:3037] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.004446 4184 raft_consensus.cc:3037] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.005601 3884 raft_consensus.cc:2454] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 1.
I20260810 14:30:31.005780 4184 raft_consensus.cc:2454] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 1.
I20260810 14:30:31.005978 3964 leader_election.cc:302] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ed1d4d68c34ef0a0892ebe3e243159, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:31.006227 4265 raft_consensus.cc:2781] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:31.006506 4265 raft_consensus.cc:686] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 LEADER]: Becoming Leader. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Running, Role: LEADER
I20260810 14:30:31.006882 4265 consensus_queue.cc:237] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } }
I20260810 14:30:31.010747 3714 catalog_manager.cc:5495] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } health_report { overall_health: HEALTHY } } }
Aug 10 14:30:31 dist-test-slave-0b58 krb5kdc[3670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372229, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:31.055194 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.046255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.1.206.126:43131)
0810 14:30:31.046427 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.046442 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.046656 (+ 214us) server_negotiation.cc:407] Connection header received
0810 14:30:31.046756 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.046759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.046802 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.046880 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:31.047679 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.048214 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.049153 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.049370 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.049453 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.051857 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:31.051860 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:31.051862 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:31.051886 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:31.053364 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:31.053864 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:31.053867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:31.053868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:31.053951 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:31.054303 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:31.054308 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:31.054309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:31.054506 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:31.054588 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.054912 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.055052 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":81}
I20260810 14:30:31.055198 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.046173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43131 (local address 127.0.0.1:45082)
0810 14:30:31.046540 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.046554 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.046671 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.046950 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.046953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.047411 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:31.047518 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.047525 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.048424 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.048427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.048999 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.049008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.049487 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.049490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.049555 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.050209 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:31.050221 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:31.051703 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:31.053479 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:31.053489 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:31.053495 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:31.053743 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:31.054079 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:31.054082 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:31.054083 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:31.054188 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:31.054611 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:31.054617 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:31.054737 (+ 120us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.054853 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.054993 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":145,"threads_started":1}
W20260810 14:30:31.058338 4085 tablet.cc:2369] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:31.060323 3714 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:45082:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 14:30:31.061451 3714 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 14:30:31.063035 3935 tablet.cc:2369] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:31.067601 3861 tablet_service.cc:1467] Processing CreateTablet for tablet 203df8031d954f42b7c2b9014d4cf912 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f54ec89964d84436827218b53a5372dc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:30:31.067586 4013 tablet_service.cc:1467] Processing CreateTablet for tablet 203df8031d954f42b7c2b9014d4cf912 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f54ec89964d84436827218b53a5372dc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:30:31.067761 4163 tablet_service.cc:1467] Processing CreateTablet for tablet 203df8031d954f42b7c2b9014d4cf912 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f54ec89964d84436827218b53a5372dc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:30:31.068446 4163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203df8031d954f42b7c2b9014d4cf912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:31.068445 4013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203df8031d954f42b7c2b9014d4cf912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:31.068466 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 203df8031d954f42b7c2b9014d4cf912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:31.071314 4260 tablet_bootstrap.cc:492] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: Bootstrap starting.
I20260810 14:30:31.071655 4259 tablet_bootstrap.cc:492] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: Bootstrap starting.
I20260810 14:30:31.072781 4261 tablet_bootstrap.cc:492] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: Bootstrap starting.
I20260810 14:30:31.072831 4260 tablet_bootstrap.cc:654] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:31.072830 4259 tablet_bootstrap.cc:654] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:31.074033 4261 tablet_bootstrap.cc:654] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:31.074505 4259 tablet_bootstrap.cc:492] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: No bootstrap required, opened a new log
I20260810 14:30:31.074610 4259 ts_tablet_manager.cc:1397] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:31.074646 4260 tablet_bootstrap.cc:492] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: No bootstrap required, opened a new log
I20260810 14:30:31.074784 4260 ts_tablet_manager.cc:1397] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 14:30:31.075241 4259 raft_consensus.cc:348] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.075412 4259 raft_consensus.cc:374] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:31.075344 4260 raft_consensus.cc:348] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.075453 4259 raft_consensus.cc:729] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Initialized, Role: FOLLOWER
I20260810 14:30:31.075480 4260 raft_consensus.cc:374] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:31.075500 4261 tablet_bootstrap.cc:492] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: No bootstrap required, opened a new log
I20260810 14:30:31.075528 4260 raft_consensus.cc:729] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfe593e322e4060a228236b7724557b, State: Initialized, Role: FOLLOWER
I20260810 14:30:31.075587 4261 ts_tablet_manager.cc:1397] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 14:30:31.075626 4259 consensus_queue.cc:260] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.075665 4260 consensus_queue.cc:260] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.075981 4260 ts_tablet_manager.cc:1428] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 14:30:31.075918 4265 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.076056 4265 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:31.076097 4261 raft_consensus.cc:348] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.076395 4266 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.076508 4259 ts_tablet_manager.cc:1428] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:31.076540 4266 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:31.076689 4261 raft_consensus.cc:374] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:31.076858 4261 raft_consensus.cc:729] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedd9abe03684947bee6a2c9cd1112d2, State: Initialized, Role: FOLLOWER
I20260810 14:30:31.077036 4261 consensus_queue.cc:260] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.077500 4261 ts_tablet_manager.cc:1428] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:31.077486 4267 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.077658 4267 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 14:30:31.083634 4236 tablet.cc:2369] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:31.110132 4266 raft_consensus.cc:482] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:31.110328 4266 raft_consensus.cc:504] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.111579 4266 leader_election.cc:288] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207), aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257)
I20260810 14:30:31.116118 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.112014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:51709 (local address 127.1.206.67:46257)
0810 14:30:31.112144 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.112151 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.112523 (+ 372us) server_negotiation.cc:407] Connection header received
0810 14:30:31.112643 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.112645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.112690 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.112754 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:31.113228 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.113847 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.114977 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.115384 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.115525 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.115584 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.115894 (+ 310us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.115980 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:30:31.116154 4280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.111895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:46257 (local address 127.1.206.65:51709)
0810 14:30:31.112376 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.112389 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.112530 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.112789 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.112792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.112808 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:31.113033 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.113042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.113985 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.113988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.114838 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.114847 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.115532 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.115535 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.115720 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.115742 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.115870 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.115969 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":44,"spinlock_wait_cycles":16256,"thread_start_us":131,"threads_started":1}
I20260810 14:30:31.116701 4281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.111893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46207 (local address 127.1.206.65:58945)
0810 14:30:31.112360 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.112377 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.112530 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.113115 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.113118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.113135 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:31.113847 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.113859 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.114604 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.114608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.115358 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.115367 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.116025 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.116028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.116131 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.116158 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.116437 (+ 279us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.116504 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"spinlock_wait_cycles":19584,"thread_start_us":161,"threads_started":1}
I20260810 14:30:31.116659 4184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203df8031d954f42b7c2b9014d4cf912" candidate_uuid: "ecfe593e322e4060a228236b7724557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2" is_pre_election: true
I20260810 14:30:31.116730 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.111973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:58945 (local address 127.1.206.66:46207)
0810 14:30:31.112125 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.112130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.112479 (+ 349us) server_negotiation.cc:407] Connection header received
0810 14:30:31.112927 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.112930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.112986 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.113099 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:31.113967 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.114481 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.115484 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.115900 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.116033 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.116105 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.116481 (+ 376us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.116581 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 14:30:31.116832 4184 raft_consensus.cc:2454] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfe593e322e4060a228236b7724557b in term 0.
I20260810 14:30:31.117254 3811 leader_election.cc:302] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aedd9abe03684947bee6a2c9cd1112d2, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:31.117597 4266 raft_consensus.cc:2781] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:31.117590 4034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203df8031d954f42b7c2b9014d4cf912" candidate_uuid: "ecfe593e322e4060a228236b7724557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" is_pre_election: true
I20260810 14:30:31.117676 4266 raft_consensus.cc:482] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:31.117729 4266 raft_consensus.cc:3037] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.117838 4034 raft_consensus.cc:2454] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecfe593e322e4060a228236b7724557b in term 0.
I20260810 14:30:31.118851 4266 raft_consensus.cc:504] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.119174 4266 leader_election.cc:288] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [CANDIDATE]: Term 1 election: Requested vote from peers 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207), aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257)
I20260810 14:30:31.119565 4034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203df8031d954f42b7c2b9014d4cf912" candidate_uuid: "ecfe593e322e4060a228236b7724557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ed1d4d68c34ef0a0892ebe3e243159"
I20260810 14:30:31.119585 4184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203df8031d954f42b7c2b9014d4cf912" candidate_uuid: "ecfe593e322e4060a228236b7724557b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2"
I20260810 14:30:31.119685 4034 raft_consensus.cc:3037] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.119769 4184 raft_consensus.cc:3037] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.120806 4184 raft_consensus.cc:2454] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfe593e322e4060a228236b7724557b in term 1.
I20260810 14:30:31.120817 4034 raft_consensus.cc:2454] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecfe593e322e4060a228236b7724557b in term 1.
I20260810 14:30:31.121179 3813 leader_election.cc:302] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 68ed1d4d68c34ef0a0892ebe3e243159, aedd9abe03684947bee6a2c9cd1112d2, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:31.121417 4266 raft_consensus.cc:2781] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:31.121687 4266 raft_consensus.cc:686] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [term 1 LEADER]: Becoming Leader. State: Replica: ecfe593e322e4060a228236b7724557b, State: Running, Role: LEADER
I20260810 14:30:31.122125 4266 consensus_queue.cc:237] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.125540 4282 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: TxnStatusTablet state changed. Reason: New leader ecfe593e322e4060a228236b7724557b. Latest consensus state: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.125705 4282 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:30:31.126024 4284 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 14:30:31.126258 4284 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 14:30:31.126202 3715 catalog_manager.cc:5495] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b reported cstate change: term changed from 0 to 1, leader changed from <none> to ecfe593e322e4060a228236b7724557b (127.1.206.65). New cstate: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260810 14:30:31.149367 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.144751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43782 (local address 127.1.206.65:45833)
0810 14:30:31.144898 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.144903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.144969 (+ 66us) server_negotiation.cc:407] Connection header received
0810 14:30:31.145199 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.145203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.145266 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.145360 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:31.145641 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.146177 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.147486 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.147725 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.147813 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.148371 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.148915 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.149029 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.149149 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.149213 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:30:31.149420 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.144619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45833 (local address 127.0.0.1:43782)
0810 14:30:31.144906 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.144922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.145046 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.145403 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.145407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.145415 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:31.145539 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.145545 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.146303 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.146306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.147328 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.147343 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.147861 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.147865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.147972 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.148044 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.149034 (+ 990us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.149056 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.149136 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.149254 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260810 14:30:31.155912 4184 raft_consensus.cc:1261] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Refusing update from remote peer ecfe593e322e4060a228236b7724557b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:31.156065 4034 raft_consensus.cc:1261] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Refusing update from remote peer ecfe593e322e4060a228236b7724557b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:31.156821 4266 consensus_queue.cc:1035] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [LEADER]: Connected to new peer: Peer: permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:31.157051 4282 consensus_queue.cc:1035] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:31.160883 4265 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: TxnStatusTablet state changed. Reason: New leader ecfe593e322e4060a228236b7724557b. Latest consensus state: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.161044 4265 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:31.162211 4267 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: TxnStatusTablet state changed. Reason: New leader ecfe593e322e4060a228236b7724557b. Latest consensus state: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.162346 4267 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:31.165534 4287 mvcc.cc:205] Tried to move back new op lower bound from 7316980658806341632 to 7316980658679398400. Current Snapshot: MvccSnapshot[applied={T|T < 7316980658806341632}]
I20260810 14:30:31.166348 4282 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.166477 4282 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:30:31.167173 4289 mvcc.cc:205] Tried to move back new op lower bound from 7316980658806341632 to 7316980658679398400. Current Snapshot: MvccSnapshot[applied={T|T < 7316980658806341632}]
I20260810 14:30:31.167397 4265 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.167515 4265 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P 68ed1d4d68c34ef0a0892ebe3e243159: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:31.167645 4288 mvcc.cc:205] Tried to move back new op lower bound from 7316980658806341632 to 7316980658679398400. Current Snapshot: MvccSnapshot[applied={T|T < 7316980658806341632}]
I20260810 14:30:31.168089 4267 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.168224 4267 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P aedd9abe03684947bee6a2c9cd1112d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:30:31.165537 4266 tablet_replica.cc:439] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecfe593e322e4060a228236b7724557b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } } }
I20260810 14:30:31.168550 4266 tablet_replica.cc:442] T 203df8031d954f42b7c2b9014d4cf912 P ecfe593e322e4060a228236b7724557b: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:30:31.180879 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.175707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42280 (local address 127.1.206.66:46207)
0810 14:30:31.175884 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.175889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.175908 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:30:31.176099 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.176131 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.176217 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.176365 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:31.176650 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.177489 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.178687 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.179095 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.179231 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.179517 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.180185 (+ 668us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.180367 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.180481 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.180556 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 14:30:31.195194 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.190675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:51253 (local address 127.1.206.65:45833)
0810 14:30:31.190849 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.190854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.191059 (+ 205us) server_negotiation.cc:407] Connection header received
0810 14:30:31.191223 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.191226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.191276 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.191364 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:31.191662 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.192232 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.193786 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.194059 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.194153 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.194660 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.194743 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.194806 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.195002 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.195063 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 14:30:31.195268 4300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.190562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45833 (local address 127.1.206.66:51253)
0810 14:30:31.190955 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.190972 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.191099 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.191398 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.191401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.191409 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:31.191545 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.191551 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.192387 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.192391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.193607 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.193621 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.194186 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.194190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.194398 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.194467 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.194840 (+ 373us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.194848 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.194976 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.195074 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":133,"threads_started":1}
I20260810 14:30:31.203450 4184 raft_consensus.cc:1261] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Refusing update from remote peer 68ed1d4d68c34ef0a0892ebe3e243159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:31.203944 3884 raft_consensus.cc:1261] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Refusing update from remote peer 68ed1d4d68c34ef0a0892ebe3e243159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:31.204085 4265 consensus_queue.cc:1035] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:31.204890 4265 consensus_queue.cc:1035] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:31.233712 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.228670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:42869 (local address 127.1.206.66:46207)
0810 14:30:31.228800 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.228805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.229085 (+ 280us) server_negotiation.cc:407] Connection header received
0810 14:30:31.229247 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.229251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.229307 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.229392 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:31.230075 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.230889 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.232190 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.232542 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.232689 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.233105 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.233218 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.233317 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.233456 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.233534 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 14:30:31.233784 4305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.228558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46207 (local address 127.1.206.65:42869)
0810 14:30:31.228953 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.228968 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.229119 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.229414 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.229418 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.229428 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:31.229948 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.229960 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.231024 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.231027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.232036 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.232049 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.232731 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.232735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.232874 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.232946 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.233338 (+ 392us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.233346 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.233419 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.233523 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":135,"threads_started":1}
I20260810 14:30:31.263167 3714 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:31.263432 3714 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:31.266917 3714 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Sending DeleteTablet for 3 replicas of tablet 723f8377017f4883bac6168b9c55d96d
I20260810 14:30:31.267867 4163 tablet_service.cc:1514] Processing DeleteTablet for tablet 723f8377017f4883bac6168b9c55d96d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:46724
I20260810 14:30:31.268184 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet 723f8377017f4883bac6168b9c55d96d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:43766
I20260810 14:30:31.268867 4013 tablet_service.cc:1514] Processing DeleteTablet for tablet 723f8377017f4883bac6168b9c55d96d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:42266
I20260810 14:30:31.269462 4309 tablet_replica.cc:330] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: stopping tablet replica
I20260810 14:30:31.269737 4311 tablet_replica.cc:330] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: stopping tablet replica
I20260810 14:30:31.269706 3714 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45072:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:31.270257 3714 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:31.270623 4311 raft_consensus.cc:2229] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:31.270972 4309 raft_consensus.cc:2229] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:31.271581 4311 raft_consensus.cc:2258] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:31.271947 4310 tablet_replica.cc:330] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: stopping tablet replica
I20260810 14:30:31.272315 4310 raft_consensus.cc:2229] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:31.272526 4310 raft_consensus.cc:2258] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:31.274502 4310 ts_tablet_manager.cc:1905] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:31.278002 3861 tablet_service.cc:1467] Processing CreateTablet for tablet a11e2fc4894146f5b58eb1ae95942927 (DEFAULT_TABLE table=test-table [id=4440f39a21734f58884272482fc1c16b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:31.278364 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a11e2fc4894146f5b58eb1ae95942927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:31.278388 4163 tablet_service.cc:1467] Processing CreateTablet for tablet a11e2fc4894146f5b58eb1ae95942927 (DEFAULT_TABLE table=test-table [id=4440f39a21734f58884272482fc1c16b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:31.278911 4163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a11e2fc4894146f5b58eb1ae95942927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:31.281402 4260 tablet_bootstrap.cc:492] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: Bootstrap starting.
I20260810 14:30:31.281960 4261 tablet_bootstrap.cc:492] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: Bootstrap starting.
I20260810 14:30:31.282608 4260 tablet_bootstrap.cc:654] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:31.283012 4261 tablet_bootstrap.cc:654] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:31.284482 4309 raft_consensus.cc:2258] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:31.281910 4013 tablet_service.cc:1467] Processing CreateTablet for tablet a11e2fc4894146f5b58eb1ae95942927 (DEFAULT_TABLE table=test-table [id=4440f39a21734f58884272482fc1c16b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:31.284970 4013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a11e2fc4894146f5b58eb1ae95942927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:31.287379 4310 ts_tablet_manager.cc:1918] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:31.287528 4310 log.cc:1196] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/723f8377017f4883bac6168b9c55d96d
I20260810 14:30:31.288043 4310 ts_tablet_manager.cc:1939] T 723f8377017f4883bac6168b9c55d96d P ecfe593e322e4060a228236b7724557b: Deleting consensus metadata
I20260810 14:30:31.288443 4259 tablet_bootstrap.cc:492] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: Bootstrap starting.
I20260810 14:30:31.289752 4259 tablet_bootstrap.cc:654] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:31.290736 3702 catalog_manager.cc:4841] TS ecfe593e322e4060a228236b7724557b (127.1.206.65:45833): tablet 723f8377017f4883bac6168b9c55d96d (table test-table [id=3f3dd133235946c2ac48ecf9a0c02e33]) successfully deleted
I20260810 14:30:31.293201 4261 tablet_bootstrap.cc:492] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: No bootstrap required, opened a new log
I20260810 14:30:31.293322 4261 ts_tablet_manager.cc:1397] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260810 14:30:31.293460 4260 tablet_bootstrap.cc:492] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: No bootstrap required, opened a new log
I20260810 14:30:31.293551 4260 ts_tablet_manager.cc:1397] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260810 14:30:31.293859 4261 raft_consensus.cc:348] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.294008 4261 raft_consensus.cc:374] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:31.294047 4261 raft_consensus.cc:729] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedd9abe03684947bee6a2c9cd1112d2, State: Initialized, Role: FOLLOWER
I20260810 14:30:31.294126 4260 raft_consensus.cc:348] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.294243 4260 raft_consensus.cc:374] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:31.294210 4261 consensus_queue.cc:260] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.294274 4260 raft_consensus.cc:729] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfe593e322e4060a228236b7724557b, State: Initialized, Role: FOLLOWER
I20260810 14:30:31.294394 4260 consensus_queue.cc:260] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.294514 4261 ts_tablet_manager.cc:1428] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:31.294657 4260 ts_tablet_manager.cc:1428] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:31.299685 4309 ts_tablet_manager.cc:1905] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:31.300359 4311 ts_tablet_manager.cc:1905] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:31.304013 4311 ts_tablet_manager.cc:1918] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:31.304245 4311 log.cc:1196] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/723f8377017f4883bac6168b9c55d96d
I20260810 14:30:31.304428 4259 tablet_bootstrap.cc:492] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: No bootstrap required, opened a new log
I20260810 14:30:31.304543 4259 ts_tablet_manager.cc:1397] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260810 14:30:31.304811 4311 ts_tablet_manager.cc:1939] T 723f8377017f4883bac6168b9c55d96d P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting consensus metadata
I20260810 14:30:31.305068 4259 raft_consensus.cc:348] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.305202 4259 raft_consensus.cc:374] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:31.305236 4259 raft_consensus.cc:729] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Initialized, Role: FOLLOWER
I20260810 14:30:31.305377 4259 consensus_queue.cc:260] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.305652 4259 ts_tablet_manager.cc:1428] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 14:30:31.306490 3702 catalog_manager.cc:4841] TS 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207): tablet 723f8377017f4883bac6168b9c55d96d (table test-table [id=3f3dd133235946c2ac48ecf9a0c02e33]) successfully deleted
I20260810 14:30:31.307551 4309 ts_tablet_manager.cc:1918] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:31.307817 4309 log.cc:1196] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/723f8377017f4883bac6168b9c55d96d
I20260810 14:30:31.310032 4309 ts_tablet_manager.cc:1939] T 723f8377017f4883bac6168b9c55d96d P aedd9abe03684947bee6a2c9cd1112d2: Deleting consensus metadata
I20260810 14:30:31.312423 3700 catalog_manager.cc:4841] TS aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257): tablet 723f8377017f4883bac6168b9c55d96d (table test-table [id=3f3dd133235946c2ac48ecf9a0c02e33]) successfully deleted
I20260810 14:30:31.465468 4267 raft_consensus.cc:482] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:31.465674 4267 raft_consensus.cc:504] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.466908 4267 leader_election.cc:288] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecfe593e322e4060a228236b7724557b (127.1.206.65:45833), 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207)
I20260810 14:30:31.471343 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.467931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:37847 (local address 127.1.206.66:46207)
0810 14:30:31.468067 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.468074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.468115 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:30:31.468288 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.468292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.468346 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.468443 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:31.468711 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.469222 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.470317 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.470736 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.470882 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.470938 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.471129 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.471214 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 14:30:31.471361 4316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.467787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46207 (local address 127.1.206.67:37847)
0810 14:30:31.468047 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.468059 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.468144 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.468456 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.468459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.468475 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:31.468594 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.468600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.469344 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.469348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.470162 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.470172 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.470871 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.470875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.470984 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.471007 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.471109 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.471190 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":16,"thread_start_us":85,"threads_started":1}
I20260810 14:30:31.471477 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.467390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44411 (local address 127.1.206.65:45833)
0810 14:30:31.467585 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.467590 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.467722 (+ 132us) server_negotiation.cc:407] Connection header received
0810 14:30:31.467972 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.467976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.468039 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.468150 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:31.468481 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.469021 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.470244 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.470681 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.470822 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.470887 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.471228 (+ 341us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.471323 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260810 14:30:31.471529 4315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.467243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45833 (local address 127.1.206.67:44411)
0810 14:30:31.467603 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.467620 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.467804 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.468171 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.468174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.468193 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:31.468362 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.468369 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.469170 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.469174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.470092 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.470103 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.470823 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.470826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.471041 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.471076 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.471206 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.471298 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":27,"thread_start_us":104,"threads_started":1}
I20260810 14:30:31.472304 4034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a11e2fc4894146f5b58eb1ae95942927" candidate_uuid: "aedd9abe03684947bee6a2c9cd1112d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" is_pre_election: true
I20260810 14:30:31.472553 4034 raft_consensus.cc:2454] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aedd9abe03684947bee6a2c9cd1112d2 in term 0.
I20260810 14:30:31.472520 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a11e2fc4894146f5b58eb1ae95942927" candidate_uuid: "aedd9abe03684947bee6a2c9cd1112d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b" is_pre_election: true
I20260810 14:30:31.472697 3884 raft_consensus.cc:2454] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aedd9abe03684947bee6a2c9cd1112d2 in term 0.
I20260810 14:30:31.473219 4114 leader_election.cc:302] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aedd9abe03684947bee6a2c9cd1112d2, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:31.473783 4267 raft_consensus.cc:2781] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:31.473945 4267 raft_consensus.cc:482] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:31.474107 4267 raft_consensus.cc:3037] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.475878 4267 raft_consensus.cc:504] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.476475 4267 leader_election.cc:288] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [CANDIDATE]: Term 1 election: Requested vote from peers ecfe593e322e4060a228236b7724557b (127.1.206.65:45833), 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207)
I20260810 14:30:31.477058 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a11e2fc4894146f5b58eb1ae95942927" candidate_uuid: "aedd9abe03684947bee6a2c9cd1112d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b"
I20260810 14:30:31.477140 4034 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a11e2fc4894146f5b58eb1ae95942927" candidate_uuid: "aedd9abe03684947bee6a2c9cd1112d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ed1d4d68c34ef0a0892ebe3e243159"
I20260810 14:30:31.477226 3884 raft_consensus.cc:3037] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.477303 4034 raft_consensus.cc:3037] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:31.478606 4034 raft_consensus.cc:2454] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aedd9abe03684947bee6a2c9cd1112d2 in term 1.
I20260810 14:30:31.478606 3884 raft_consensus.cc:2454] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aedd9abe03684947bee6a2c9cd1112d2 in term 1.
I20260810 14:30:31.479048 4114 leader_election.cc:302] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aedd9abe03684947bee6a2c9cd1112d2, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:31.479351 4267 raft_consensus.cc:2781] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:31.479593 4267 raft_consensus.cc:686] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 1 LEADER]: Becoming Leader. State: Replica: aedd9abe03684947bee6a2c9cd1112d2, State: Running, Role: LEADER
I20260810 14:30:31.479916 4267 consensus_queue.cc:237] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:31.482635 3714 catalog_manager.cc:5495] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67). New cstate: current_term: 1 leader_uuid: "aedd9abe03684947bee6a2c9cd1112d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } health_report { overall_health: HEALTHY } } }
I20260810 14:30:31.540094 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.536560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46728 (local address 127.1.206.67:46257)
0810 14:30:31.536677 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.536680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.536694 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:30:31.536873 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.536876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.536936 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.537028 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:31.537248 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.537741 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.538649 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.538870 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.538948 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.539164 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.539662 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.539749 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.539894 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.539948 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 14:30:31.551599 4322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.547903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45833 (local address 127.1.206.67:49835)
0810 14:30:31.548205 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.548219 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.548346 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.548578 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.548580 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.548586 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:31.548711 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.548715 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.549524 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.549526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.550234 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.550244 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.550749 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.550752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.550827 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.550877 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.551280 (+ 403us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.551287 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.551364 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.551444 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":111,"threads_started":1}
I20260810 14:30:31.551605 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.548058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:49835 (local address 127.1.206.65:45833)
0810 14:30:31.548203 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.548207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.548342 (+ 135us) server_negotiation.cc:407] Connection header received
0810 14:30:31.548427 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.548429 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.548478 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.548551 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:31.548839 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.549365 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.550378 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.550609 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.550713 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.551054 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.551139 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.551209 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.551429 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.551493 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:30:31.560917 4034 raft_consensus.cc:1261] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Refusing update from remote peer aedd9abe03684947bee6a2c9cd1112d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:31.561007 3884 raft_consensus.cc:1261] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Refusing update from remote peer aedd9abe03684947bee6a2c9cd1112d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:31.561712 4317 consensus_queue.cc:1035] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:31.561925 4267 consensus_queue.cc:1035] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:31.585904 4305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.581284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:46257 (local address 127.1.206.65:46073)
0810 14:30:31.581543 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:31.581560 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:31.581646 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:31.582229 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:31.582232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:31.582241 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:30:31.582343 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.582348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.583431 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.583435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.584463 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:31.584474 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.585122 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.585126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:31.585204 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.585236 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.585624 (+ 388us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.585631 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 14:30:31.585698 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 14:30:31.585789 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260810 14:30:31.585964 4255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:31.581803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:46073 (local address 127.1.206.67:46257)
0810 14:30:31.581935 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:31.581940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:31.581954 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:30:31.582002 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:31.582005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:31.582053 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:31.582121 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:31.582460 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.583296 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.584607 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:31.584957 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:31.585064 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:31.585401 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:31.585495 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:31.585575 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:31.585716 (+ 141us) server_negotiation.cc:299] Negotiation successful
0810 14:30:31.585772 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 14:30:31.586916 4288 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 14:30:33.170979 3715 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:33.171166 3715 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45072:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:33.174422 3715 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Sending DeleteTablet for 3 replicas of tablet a11e2fc4894146f5b58eb1ae95942927
I20260810 14:30:33.175225 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet a11e2fc4894146f5b58eb1ae95942927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:33 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:43766
I20260810 14:30:33.175276 4013 tablet_service.cc:1514] Processing DeleteTablet for tablet a11e2fc4894146f5b58eb1ae95942927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:33 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:42266
I20260810 14:30:33.175276 4163 tablet_service.cc:1514] Processing DeleteTablet for tablet a11e2fc4894146f5b58eb1ae95942927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:33 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:46724
I20260810 14:30:33.175668 4354 tablet_replica.cc:330] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: stopping tablet replica
I20260810 14:30:33.175695 4352 tablet_replica.cc:330] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: stopping tablet replica
I20260810 14:30:33.175837 4354 raft_consensus.cc:2229] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:33.175837 4352 raft_consensus.cc:2229] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:33.175966 4352 raft_consensus.cc:2258] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:33.176211 4354 raft_consensus.cc:2258] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:33.176503 4353 tablet_replica.cc:330] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: stopping tablet replica
I20260810 14:30:33.176625 4353 raft_consensus.cc:2229] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:33.176748 4353 raft_consensus.cc:2258] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:33.176776 4352 ts_tablet_manager.cc:1905] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:33.180632 4352 ts_tablet_manager.cc:1918] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:30:33.181165 4352 log.cc:1196] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/a11e2fc4894146f5b58eb1ae95942927
I20260810 14:30:33.181113 4354 ts_tablet_manager.cc:1905] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:33.181589 4352 ts_tablet_manager.cc:1939] T a11e2fc4894146f5b58eb1ae95942927 P ecfe593e322e4060a228236b7724557b: Deleting consensus metadata
I20260810 14:30:33.182595 3702 catalog_manager.cc:4841] TS ecfe593e322e4060a228236b7724557b (127.1.206.65:45833): tablet a11e2fc4894146f5b58eb1ae95942927 (table test-table [id=4440f39a21734f58884272482fc1c16b]) successfully deleted
I20260810 14:30:33.183144 4353 ts_tablet_manager.cc:1905] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:33.184652 4354 ts_tablet_manager.cc:1918] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:30:33.184814 4354 log.cc:1196] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/a11e2fc4894146f5b58eb1ae95942927
I20260810 14:30:33.185170 4354 ts_tablet_manager.cc:1939] T a11e2fc4894146f5b58eb1ae95942927 P aedd9abe03684947bee6a2c9cd1112d2: Deleting consensus metadata
I20260810 14:30:33.186266 3700 catalog_manager.cc:4841] TS aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257): tablet a11e2fc4894146f5b58eb1ae95942927 (table test-table [id=4440f39a21734f58884272482fc1c16b]) successfully deleted
I20260810 14:30:33.186563 4353 ts_tablet_manager.cc:1918] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:30:33.186707 4353 log.cc:1196] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/a11e2fc4894146f5b58eb1ae95942927
I20260810 14:30:33.187039 4353 ts_tablet_manager.cc:1939] T a11e2fc4894146f5b58eb1ae95942927 P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting consensus metadata
I20260810 14:30:33.188243 3702 catalog_manager.cc:4841] TS 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207): tablet a11e2fc4894146f5b58eb1ae95942927 (table test-table [id=4440f39a21734f58884272482fc1c16b]) successfully deleted
Aug 10 14:30:33 dist-test-slave-0b58 krb5kdc[3670](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372233, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:30:33 dist-test-slave-0b58 krb5kdc[3670](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372233, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:33.215308 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:33.200855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45090 (local address 127.1.206.126:43131)
0810 14:30:33.201294 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:33.201306 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:33.201327 (+ 21us) server_negotiation.cc:407] Connection header received
0810 14:30:33.201534 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:33.201537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:33.201598 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:33.201705 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:33.202509 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:33.203092 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:33.204017 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:33.204369 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:33.204506 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:33.211214 (+ 6708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:33.211218 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:33.211220 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:33.211256 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:33.213153 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:33.213764 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:33.213768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:33.213769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:33.213871 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:33.214217 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:33.214222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:33.214224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:33.214464 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:33.214628 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:33.214935 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 14:30:33.215096 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":134,"threads_started":1}
I20260810 14:30:33.218744 3715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:33.219290 3715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:33.225081 3861 tablet_service.cc:1467] Processing CreateTablet for tablet 38aa2f65061945cf96036576f73e042d (DEFAULT_TABLE table=test-table [id=91b1f764ad58437c9050abe452df093d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:33.225086 4163 tablet_service.cc:1467] Processing CreateTablet for tablet 38aa2f65061945cf96036576f73e042d (DEFAULT_TABLE table=test-table [id=91b1f764ad58437c9050abe452df093d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:33.225095 4013 tablet_service.cc:1467] Processing CreateTablet for tablet 38aa2f65061945cf96036576f73e042d (DEFAULT_TABLE table=test-table [id=91b1f764ad58437c9050abe452df093d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:33.225431 4013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38aa2f65061945cf96036576f73e042d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:33.225437 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38aa2f65061945cf96036576f73e042d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:33.225438 4163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38aa2f65061945cf96036576f73e042d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:33.228446 4364 tablet_bootstrap.cc:492] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: Bootstrap starting.
I20260810 14:30:33.228569 4365 tablet_bootstrap.cc:492] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: Bootstrap starting.
I20260810 14:30:33.229415 4366 tablet_bootstrap.cc:492] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: Bootstrap starting.
I20260810 14:30:33.229557 4364 tablet_bootstrap.cc:654] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:33.229566 4365 tablet_bootstrap.cc:654] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:33.230391 4366 tablet_bootstrap.cc:654] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:33.230856 4365 tablet_bootstrap.cc:492] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: No bootstrap required, opened a new log
I20260810 14:30:33.230968 4365 ts_tablet_manager.cc:1397] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:33.231231 4364 tablet_bootstrap.cc:492] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: No bootstrap required, opened a new log
I20260810 14:30:33.231338 4364 ts_tablet_manager.cc:1397] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:33.231467 4365 raft_consensus.cc:348] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.231619 4365 raft_consensus.cc:374] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:33.231662 4365 raft_consensus.cc:729] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfe593e322e4060a228236b7724557b, State: Initialized, Role: FOLLOWER
I20260810 14:30:33.231806 4365 consensus_queue.cc:260] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.231868 4364 raft_consensus.cc:348] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.231997 4364 raft_consensus.cc:374] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:33.232043 4364 raft_consensus.cc:729] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Initialized, Role: FOLLOWER
I20260810 14:30:33.232071 4366 tablet_bootstrap.cc:492] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: No bootstrap required, opened a new log
I20260810 14:30:33.232180 4366 ts_tablet_manager.cc:1397] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:33.232232 4364 consensus_queue.cc:260] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.232713 4365 ts_tablet_manager.cc:1428] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:33.232728 4364 ts_tablet_manager.cc:1428] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260810 14:30:33.232690 4366 raft_consensus.cc:348] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.232813 4366 raft_consensus.cc:374] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:33.232849 4366 raft_consensus.cc:729] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedd9abe03684947bee6a2c9cd1112d2, State: Initialized, Role: FOLLOWER
I20260810 14:30:33.232970 4366 consensus_queue.cc:260] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.233248 4366 ts_tablet_manager.cc:1428] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:33.569438 4370 raft_consensus.cc:482] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:33.569636 4370 raft_consensus.cc:504] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.570153 4370 leader_election.cc:288] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecfe593e322e4060a228236b7724557b (127.1.206.65:45833), aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257)
I20260810 14:30:33.570705 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38aa2f65061945cf96036576f73e042d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b" is_pre_election: true
I20260810 14:30:33.570713 4184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38aa2f65061945cf96036576f73e042d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2" is_pre_election: true
I20260810 14:30:33.570888 3884 raft_consensus.cc:2454] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 0.
I20260810 14:30:33.570897 4184 raft_consensus.cc:2454] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 0.
I20260810 14:30:33.571303 3964 leader_election.cc:302] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ed1d4d68c34ef0a0892ebe3e243159, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:33.571533 4370 raft_consensus.cc:2781] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:33.571606 4370 raft_consensus.cc:482] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:33.571655 4370 raft_consensus.cc:3037] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:33.572793 4370 raft_consensus.cc:504] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.573200 4370 leader_election.cc:288] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 election: Requested vote from peers ecfe593e322e4060a228236b7724557b (127.1.206.65:45833), aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257)
I20260810 14:30:33.573686 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38aa2f65061945cf96036576f73e042d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b"
I20260810 14:30:33.573693 4184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38aa2f65061945cf96036576f73e042d" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2"
I20260810 14:30:33.573848 3884 raft_consensus.cc:3037] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:33.573859 4184 raft_consensus.cc:3037] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:33.575882 3884 raft_consensus.cc:2454] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 1.
I20260810 14:30:33.575109 4184 raft_consensus.cc:2454] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 1.
I20260810 14:30:33.576424 3964 leader_election.cc:302] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ed1d4d68c34ef0a0892ebe3e243159, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:33.576841 4370 raft_consensus.cc:2781] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:33.577368 4370 raft_consensus.cc:686] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 LEADER]: Becoming Leader. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Running, Role: LEADER
I20260810 14:30:33.577577 4370 consensus_queue.cc:237] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.580127 3714 catalog_manager.cc:5495] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260810 14:30:33.616899 4375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:33.613131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42296 (local address 127.1.206.66:46207)
0810 14:30:33.613498 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:33.613505 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:33.613520 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:30:33.613569 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:33.613571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:33.613615 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:33.613695 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:33.613993 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:33.614520 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:33.615414 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:33.615647 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:33.615743 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:33.616077 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:33.616174 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:33.616274 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:33.616516 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 14:30:33.616623 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":175,"threads_started":1}
I20260810 14:30:33.624858 3884 raft_consensus.cc:1261] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Refusing update from remote peer 68ed1d4d68c34ef0a0892ebe3e243159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:33.625386 4184 raft_consensus.cc:1261] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Refusing update from remote peer 68ed1d4d68c34ef0a0892ebe3e243159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:33.625396 4370 consensus_queue.cc:1035] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:33.625864 4370 consensus_queue.cc:1035] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:33.667325 3716 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:33.667543 3716 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:33.670146 3716 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Sending DeleteTablet for 3 replicas of tablet 38aa2f65061945cf96036576f73e042d
I20260810 14:30:33.671049 4013 tablet_service.cc:1514] Processing DeleteTablet for tablet 38aa2f65061945cf96036576f73e042d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:33 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:42266
I20260810 14:30:33.671056 4163 tablet_service.cc:1514] Processing DeleteTablet for tablet 38aa2f65061945cf96036576f73e042d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:33 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:46724
I20260810 14:30:33.671289 4353 tablet_replica.cc:330] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: stopping tablet replica
I20260810 14:30:33.671295 4354 tablet_replica.cc:330] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: stopping tablet replica
I20260810 14:30:33.671307 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet 38aa2f65061945cf96036576f73e042d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:33 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:43766
I20260810 14:30:33.671430 4353 raft_consensus.cc:2229] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:33.671442 4354 raft_consensus.cc:2229] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:33.671542 4352 tablet_replica.cc:330] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: stopping tablet replica
I20260810 14:30:33.671566 4354 raft_consensus.cc:2258] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:33.671660 4353 raft_consensus.cc:2258] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:33.671689 4352 raft_consensus.cc:2229] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:33.671828 4352 raft_consensus.cc:2258] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:33.671948 3716 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:33.672519 3716 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:33.672722 4352 ts_tablet_manager.cc:1905] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:33.672825 4353 ts_tablet_manager.cc:1905] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:33.672878 4354 ts_tablet_manager.cc:1905] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:33.676008 4353 ts_tablet_manager.cc:1918] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:33.676008 4354 ts_tablet_manager.cc:1918] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:33.676120 4353 log.cc:1196] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/38aa2f65061945cf96036576f73e042d
I20260810 14:30:33.676120 4354 log.cc:1196] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/38aa2f65061945cf96036576f73e042d
I20260810 14:30:33.676451 4353 ts_tablet_manager.cc:1939] T 38aa2f65061945cf96036576f73e042d P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting consensus metadata
I20260810 14:30:33.676453 4354 ts_tablet_manager.cc:1939] T 38aa2f65061945cf96036576f73e042d P aedd9abe03684947bee6a2c9cd1112d2: Deleting consensus metadata
I20260810 14:30:33.677155 4352 ts_tablet_manager.cc:1918] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:30:33.677347 4352 log.cc:1196] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/38aa2f65061945cf96036576f73e042d
I20260810 14:30:33.677748 4352 ts_tablet_manager.cc:1939] T 38aa2f65061945cf96036576f73e042d P ecfe593e322e4060a228236b7724557b: Deleting consensus metadata
I20260810 14:30:33.677845 3700 catalog_manager.cc:4841] TS aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257): tablet 38aa2f65061945cf96036576f73e042d (table test-table [id=91b1f764ad58437c9050abe452df093d]) successfully deleted
I20260810 14:30:33.678673 3702 catalog_manager.cc:4841] TS ecfe593e322e4060a228236b7724557b (127.1.206.65:45833): tablet 38aa2f65061945cf96036576f73e042d (table test-table [id=91b1f764ad58437c9050abe452df093d]) successfully deleted
I20260810 14:30:33.678867 3702 catalog_manager.cc:4841] TS 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207): tablet 38aa2f65061945cf96036576f73e042d (table test-table [id=91b1f764ad58437c9050abe452df093d]) successfully deleted
I20260810 14:30:33.679960 4013 tablet_service.cc:1467] Processing CreateTablet for tablet c7c36a37dead497fa5198fc26ab56d9f (DEFAULT_TABLE table=test-table [id=f246cf8b5c0f4c919c8b3259657f2391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:33.679958 3861 tablet_service.cc:1467] Processing CreateTablet for tablet c7c36a37dead497fa5198fc26ab56d9f (DEFAULT_TABLE table=test-table [id=f246cf8b5c0f4c919c8b3259657f2391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:33.680083 4163 tablet_service.cc:1467] Processing CreateTablet for tablet c7c36a37dead497fa5198fc26ab56d9f (DEFAULT_TABLE table=test-table [id=f246cf8b5c0f4c919c8b3259657f2391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:33.680331 3861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c36a37dead497fa5198fc26ab56d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:33.680335 4013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c36a37dead497fa5198fc26ab56d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:33.680389 4163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c36a37dead497fa5198fc26ab56d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:33.683334 4366 tablet_bootstrap.cc:492] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: Bootstrap starting.
I20260810 14:30:33.683380 4364 tablet_bootstrap.cc:492] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: Bootstrap starting.
I20260810 14:30:33.683959 4365 tablet_bootstrap.cc:492] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b: Bootstrap starting.
I20260810 14:30:33.684432 4366 tablet_bootstrap.cc:654] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:33.684546 4364 tablet_bootstrap.cc:654] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:33.685107 4365 tablet_bootstrap.cc:654] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:33.686118 4366 tablet_bootstrap.cc:492] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: No bootstrap required, opened a new log
I20260810 14:30:33.686201 4364 tablet_bootstrap.cc:492] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: No bootstrap required, opened a new log
I20260810 14:30:33.686388 4366 ts_tablet_manager.cc:1397] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260810 14:30:33.686429 4364 ts_tablet_manager.cc:1397] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:33.686895 4366 raft_consensus.cc:348] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.686903 4364 raft_consensus.cc:348] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.687022 4366 raft_consensus.cc:374] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:33.687029 4364 raft_consensus.cc:374] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:33.687029 4365 tablet_bootstrap.cc:492] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b: No bootstrap required, opened a new log
I20260810 14:30:33.687065 4364 raft_consensus.cc:729] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Initialized, Role: FOLLOWER
I20260810 14:30:33.687062 4366 raft_consensus.cc:729] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aedd9abe03684947bee6a2c9cd1112d2, State: Initialized, Role: FOLLOWER
I20260810 14:30:33.687125 4365 ts_tablet_manager.cc:1397] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:33.687209 4366 consensus_queue.cc:260] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.687268 4364 consensus_queue.cc:260] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.687536 4366 ts_tablet_manager.cc:1428] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 14:30:33.687536 4364 ts_tablet_manager.cc:1428] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:33.687625 4365 raft_consensus.cc:348] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.687748 4365 raft_consensus.cc:374] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:33.687779 4365 raft_consensus.cc:729] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecfe593e322e4060a228236b7724557b, State: Initialized, Role: FOLLOWER
I20260810 14:30:33.687920 4365 consensus_queue.cc:260] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.688237 4365 ts_tablet_manager.cc:1428] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:33.717756 4379 raft_consensus.cc:482] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:33.717912 4379 raft_consensus.cc:504] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.718381 4379 leader_election.cc:288] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecfe593e322e4060a228236b7724557b (127.1.206.65:45833), aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257)
I20260810 14:30:33.719002 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c36a37dead497fa5198fc26ab56d9f" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b" is_pre_election: true
I20260810 14:30:33.719003 4185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c36a37dead497fa5198fc26ab56d9f" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2" is_pre_election: true
I20260810 14:30:33.719202 3884 raft_consensus.cc:2454] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 0.
I20260810 14:30:33.719213 4185 raft_consensus.cc:2454] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 0.
I20260810 14:30:33.719616 3964 leader_election.cc:302] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ed1d4d68c34ef0a0892ebe3e243159, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:33.719841 4379 raft_consensus.cc:2781] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:33.719911 4379 raft_consensus.cc:482] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:33.719956 4379 raft_consensus.cc:3037] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:33.721326 4379 raft_consensus.cc:504] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.721822 4379 leader_election.cc:288] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 election: Requested vote from peers ecfe593e322e4060a228236b7724557b (127.1.206.65:45833), aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257)
I20260810 14:30:33.722321 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c36a37dead497fa5198fc26ab56d9f" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecfe593e322e4060a228236b7724557b"
I20260810 14:30:33.722491 3884 raft_consensus.cc:3037] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:33.722536 4185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c36a37dead497fa5198fc26ab56d9f" candidate_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aedd9abe03684947bee6a2c9cd1112d2"
I20260810 14:30:33.722672 4185 raft_consensus.cc:3037] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:33.724020 3884 raft_consensus.cc:2454] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 1.
I20260810 14:30:33.724069 4185 raft_consensus.cc:2454] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ed1d4d68c34ef0a0892ebe3e243159 in term 1.
I20260810 14:30:33.724444 3964 leader_election.cc:302] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ed1d4d68c34ef0a0892ebe3e243159, ecfe593e322e4060a228236b7724557b; no voters:
I20260810 14:30:33.724671 4379 raft_consensus.cc:2781] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:33.724795 4379 raft_consensus.cc:686] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 LEADER]: Becoming Leader. State: Replica: 68ed1d4d68c34ef0a0892ebe3e243159, State: Running, Role: LEADER
I20260810 14:30:33.724965 4379 consensus_queue.cc:237] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } }
I20260810 14:30:33.727077 3715 catalog_manager.cc:5495] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ed1d4d68c34ef0a0892ebe3e243159" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 } health_report { overall_health: UNKNOWN } } }
I20260810 14:30:33.753716 4185 raft_consensus.cc:1261] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Refusing update from remote peer 68ed1d4d68c34ef0a0892ebe3e243159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:33.753921 3884 raft_consensus.cc:1261] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b [term 1 FOLLOWER]: Refusing update from remote peer 68ed1d4d68c34ef0a0892ebe3e243159: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:33.754226 4379 consensus_queue.cc:1035] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aedd9abe03684947bee6a2c9cd1112d2" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 46257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:33.754405 4370 consensus_queue.cc:1035] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecfe593e322e4060a228236b7724557b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 14:30:33.771373 4334 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 14:30:35.344054 3715 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:35.344228 3715 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:35.347054 3715 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbee8ccdd95b49068a70d09465bb61a2: Sending DeleteTablet for 3 replicas of tablet c7c36a37dead497fa5198fc26ab56d9f
I20260810 14:30:35.347772 3861 tablet_service.cc:1514] Processing DeleteTablet for tablet c7c36a37dead497fa5198fc26ab56d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:35 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:43766
I20260810 14:30:35.347854 4163 tablet_service.cc:1514] Processing DeleteTablet for tablet c7c36a37dead497fa5198fc26ab56d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:35 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:46724
I20260810 14:30:35.347879 4013 tablet_service.cc:1514] Processing DeleteTablet for tablet c7c36a37dead497fa5198fc26ab56d9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:35 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:42266
I20260810 14:30:35.348248 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 3794
I20260810 14:30:35.348259 4414 tablet_replica.cc:330] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: stopping tablet replica
I20260810 14:30:35.348307 4412 tablet_replica.cc:330] T c7c36a37dead497fa5198fc26ab56d9f P ecfe593e322e4060a228236b7724557b: stopping tablet replica
I20260810 14:30:35.348306 4413 tablet_replica.cc:330] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: stopping tablet replica
I20260810 14:30:35.350961 4413 raft_consensus.cc:2229] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:35.351217 4413 raft_consensus.cc:2258] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:35.352155 4413 ts_tablet_manager.cc:1905] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:35.353609 4414 raft_consensus.cc:2229] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:35.353832 4414 raft_consensus.cc:2258] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:35.354632 4414 ts_tablet_manager.cc:1905] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:35.356168 4413 ts_tablet_manager.cc:1918] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:30:35.356303 4413 log.cc:1196] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/c7c36a37dead497fa5198fc26ab56d9f
I20260810 14:30:35.356635 4413 ts_tablet_manager.cc:1939] T c7c36a37dead497fa5198fc26ab56d9f P 68ed1d4d68c34ef0a0892ebe3e243159: Deleting consensus metadata
I20260810 14:30:35.357226 4414 ts_tablet_manager.cc:1918] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:30:35.357344 4414 log.cc:1196] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/c7c36a37dead497fa5198fc26ab56d9f
I20260810 14:30:35.357558 3702 catalog_manager.cc:4841] TS 68ed1d4d68c34ef0a0892ebe3e243159 (127.1.206.66:46207): tablet c7c36a37dead497fa5198fc26ab56d9f (table test-table [id=f246cf8b5c0f4c919c8b3259657f2391]) successfully deleted
I20260810 14:30:35.357980 4414 ts_tablet_manager.cc:1939] T c7c36a37dead497fa5198fc26ab56d9f P aedd9abe03684947bee6a2c9cd1112d2: Deleting consensus metadata
I20260810 14:30:35.358798 3700 catalog_manager.cc:4841] TS aedd9abe03684947bee6a2c9cd1112d2 (127.1.206.67:46257): tablet c7c36a37dead497fa5198fc26ab56d9f (table test-table [id=f246cf8b5c0f4c919c8b3259657f2391]) successfully deleted
W20260810 14:30:35.361289 3702 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:45833 (error 108)
I20260810 14:30:35.361555 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 3944
I20260810 14:30:35.365624 4417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:35.365101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45833 (local address 127.0.0.1:43798)
0810 14:30:35.365434 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:35.365521 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:45833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":135,"threads_started":1}
W20260810 14:30:35.365803 3702 catalog_manager.cc:4584] TS ecfe593e322e4060a228236b7724557b (127.1.206.65:45833): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c7c36a37dead497fa5198fc26ab56d9f: Network error: Client connection negotiation failed: client connection to 127.1.206.65:45833: connect: Connection refused (error 111)
I20260810 14:30:35.371871 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 4094
I20260810 14:30:35.382433 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 3683
2026-08-10T14:30:35Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6885 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:35 dist-test-slave-0b58 krb5kdc[4421](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:35 dist-test-slave-0b58 krb5kdc[4421](info): set up 2 sockets
Aug 10 14:30:35 dist-test-slave-0b58 krb5kdc[4421](info): commencing operation
krb5kdc: starting...
W20260810 14:30:36.506237 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:36 dist-test-slave-0b58 krb5kdc[4421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:36.644068 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34007
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:34007
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:36.769919 4435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:36.770345 4435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:36.770438 4435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:36.774960 4435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:36.775091 4435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:36.775130 4435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:36.775177 4435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:36.775239 4435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:36.783300 4435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:34007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:36.784711 4435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:36.785967 4435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:36.799116 4443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:36.799329 4435 server_base.cc:1034] running on GCE node
W20260810 14:30:36.799106 4441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:36.799239 4440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:36.800714 4435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:36.802090 4435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:36.803380 4435 hybrid_clock.cc:648] HybridClock initialized: now 1786372236803321 us; error 81 us; skew 500 ppm
Aug 10 14:30:36 dist-test-slave-0b58 krb5kdc[4421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372236, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:36.808230 4435 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:36.810472 4435 webserver.cc:460] Webserver started at http://127.1.206.126:42335/ using document root <none> and password file <none>
I20260810 14:30:36.811239 4435 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:36.811383 4435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:36.811681 4435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:36.814419 4435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "4aaf4cc747214b5c9a3d6b08fc93379a"
format_stamp: "Formatted at 2026-08-10 14:30:36 on dist-test-slave-0b58"
server_key: "3c0c91926544e76eb760d07d86e4371c"
server_key_iv: "f004b43b2694272447e600f694ff8bd5"
server_key_version: "encryptionkey@0"
I20260810 14:30:36.815515 4435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "4aaf4cc747214b5c9a3d6b08fc93379a"
format_stamp: "Formatted at 2026-08-10 14:30:36 on dist-test-slave-0b58"
server_key: "3c0c91926544e76eb760d07d86e4371c"
server_key_iv: "f004b43b2694272447e600f694ff8bd5"
server_key_version: "encryptionkey@0"
I20260810 14:30:36.820850 4435 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260810 14:30:36.824633 4450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:36.826313 4435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 14:30:36.826478 4435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "4aaf4cc747214b5c9a3d6b08fc93379a"
format_stamp: "Formatted at 2026-08-10 14:30:36 on dist-test-slave-0b58"
server_key: "3c0c91926544e76eb760d07d86e4371c"
server_key_iv: "f004b43b2694272447e600f694ff8bd5"
server_key_version: "encryptionkey@0"
I20260810 14:30:36.826610 4435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:36.843694 4435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:36.848193 4435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:36.848464 4435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:36.856573 4435 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:34007
I20260810 14:30:36.856711 4505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:34007 every 8 connection(s)
I20260810 14:30:36.857746 4435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:36.860934 4506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:36.862932 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 4435
I20260810 14:30:36.863036 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:36.863361 1849 external_mini_cluster.cc:1428] Setting key 1626bbb84f6ecd449d4afa57acce1d36
I20260810 14:30:36.868420 4506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a: Bootstrap starting.
I20260810 14:30:36.871321 4506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:36.872143 4506 log.cc:824] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:30:36 dist-test-slave-0b58 krb5kdc[4421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372236, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:36.874480 4506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a: No bootstrap required, opened a new log
I20260810 14:30:36.879779 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:36.864872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49166 (local address 127.1.206.126:34007)
0810 14:30:36.865336 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:36.865358 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:36.865404 (+ 46us) server_negotiation.cc:407] Connection header received
0810 14:30:36.866322 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:36.866352 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:36.866812 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:36.867217 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:36.867978 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:36.869463 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:36.870388 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:36.871079 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:36.871274 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:36.873995 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:36.874001 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:36.874019 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:36.874052 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:36.876130 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:36.876731 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:36.876741 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:36.876748 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:36.876914 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:36.877279 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:36.877282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:36.877284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:36.877876 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:36.878072 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:36.878370 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 14:30:36.878709 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":128,"threads_started":1}
I20260810 14:30:36.879614 4506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34007 } }
I20260810 14:30:36.879922 4506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:36.879989 4506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aaf4cc747214b5c9a3d6b08fc93379a, State: Initialized, Role: FOLLOWER
I20260810 14:30:36.880528 4506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34007 } }
I20260810 14:30:36.880738 4506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:36.880825 4506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:36.880954 4506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:36.882112 4506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34007 } }
I20260810 14:30:36.882541 4506 leader_election.cc:302] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aaf4cc747214b5c9a3d6b08fc93379a; no voters:
I20260810 14:30:36.882891 4506 leader_election.cc:288] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:36.883085 4511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:36.883406 4511 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [term 1 LEADER]: Becoming Leader. State: Replica: 4aaf4cc747214b5c9a3d6b08fc93379a, State: Running, Role: LEADER
I20260810 14:30:36.883738 4511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34007 } }
I20260810 14:30:36.884245 4506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:36.885639 4513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aaf4cc747214b5c9a3d6b08fc93379a. Latest consensus state: current_term: 1 leader_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34007 } } }
I20260810 14:30:36.885788 4513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:36.885627 4512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aaf4cc747214b5c9a3d6b08fc93379a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34007 } } }
I20260810 14:30:36.886169 4512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:36.886261 4521 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:36.889500 4521 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:36.896309 4521 catalog_manager.cc:1347] Generated new cluster ID: 41a9193cba3d4008af9f576bed4b60b8
I20260810 14:30:36.896450 4521 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:36.908749 4521 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:36.909878 4521 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:36.919611 4521 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4aaf4cc747214b5c9a3d6b08fc93379a: Generated new TSK 0
I20260810 14:30:36.920600 4521 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:36.963462 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34007
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:37.085364 4534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:37.085680 4534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:37.085731 4534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:37.090149 4534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:37.090246 4534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:37.090312 4534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:37.096213 4534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:37.097406 4534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:37.098459 4534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:37.109782 4541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:37.110050 4543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:37.109890 4540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:37.110153 4534 server_base.cc:1034] running on GCE node
I20260810 14:30:37.110738 4534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:37.111529 4534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:37.112749 4534 hybrid_clock.cc:648] HybridClock initialized: now 1786372237112726 us; error 39 us; skew 500 ppm
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372237, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:37.115873 4534 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:37.116981 4534 webserver.cc:460] Webserver started at http://127.1.206.65:34873/ using document root <none> and password file <none>
I20260810 14:30:37.117606 4534 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:37.117717 4534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:37.117976 4534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:37.120383 4534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "05dd1283a174411fab15f23824cbe36c"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "bb9e69041a54966ff67f6facc4566475"
server_key_iv: "1c6606481340e23c97e5a4a35b056f37"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.121142 4534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "05dd1283a174411fab15f23824cbe36c"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "bb9e69041a54966ff67f6facc4566475"
server_key_iv: "1c6606481340e23c97e5a4a35b056f37"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.125522 4534 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:30:37.128666 4550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.130232 4534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:30:37.130424 4534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "05dd1283a174411fab15f23824cbe36c"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "bb9e69041a54966ff67f6facc4566475"
server_key_iv: "1c6606481340e23c97e5a4a35b056f37"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.130578 4534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:37.149835 4534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:37.153780 4534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:37.154039 4534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:37.154709 4534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:37.155644 4534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:37.155725 4534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.155802 4534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:37.155859 4534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.166484 4534 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:42675
I20260810 14:30:37.166503 4672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:42675 every 8 connection(s)
I20260810 14:30:37.167541 4534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:37.172156 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 4534
I20260810 14:30:37.172355 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:37.172685 1849 external_mini_cluster.cc:1428] Setting key 91b4432e307ebc45dc554586ee7c4e5f
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372237, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:30:37.186060 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:37.169736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:46229 (local address 127.1.206.126:34007)
0810 14:30:37.169927 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:37.169932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:37.170860 (+ 928us) server_negotiation.cc:407] Connection header received
0810 14:30:37.172412 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:37.172419 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:37.172489 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:37.172593 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:37.174242 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.175042 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.176428 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.176747 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.176836 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:37.180531 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:37.180535 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:37.180537 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:37.180569 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:37.182480 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:37.183413 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:37.183419 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:37.183421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:37.183569 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:37.184186 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:37.184194 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:37.184195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:37.184506 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:37.184604 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:37.185707 (+ 1103us) server_negotiation.cc:299] Negotiation successful
0810 14:30:37.185914 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260810 14:30:37.187147 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:37.170154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34007 (local address 127.1.206.65:46229)
0810 14:30:37.170666 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:37.170725 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:37.172106 (+ 1381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:37.172831 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:37.172839 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:37.173349 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:37.174049 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:37.174074 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.175240 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.175243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:37.176219 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:37.176232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.176939 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.176946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:37.177231 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:37.178036 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:37.178064 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:37.180220 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:37.182676 (+ 2456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:37.182687 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:37.182712 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:37.183223 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:37.183681 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:37.183686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:37.183689 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:37.183980 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:37.184648 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:37.184657 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:37.185300 (+ 643us) client_negotiation.cc:769] Sending connection context
0810 14:30:37.185538 (+ 238us) client_negotiation.cc:240] Negotiation successful
0810 14:30:37.185986 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":124,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:30:37.188714 4673 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34007
I20260810 14:30:37.189036 4673 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:37.189823 4673 heartbeater.cc:511] Master 127.1.206.126:34007 requested a full tablet report, sending...
I20260810 14:30:37.192022 4468 ts_manager.cc:194] Registered new tserver with Master: 05dd1283a174411fab15f23824cbe36c (127.1.206.65:42675)
I20260810 14:30:37.193460 4468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:46229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:37.207875 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34007
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:37.345896 4679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:37.346220 4679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:37.346274 4679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:37.350625 4679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:37.350718 4679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:37.350781 4679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:37.356971 4679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:37.358243 4679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:37.359519 4679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:30:37.371070 4679 server_base.cc:1034] running on GCE node
W20260810 14:30:37.371060 4684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:37.371097 4685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:37.371057 4687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:37.371928 4679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:37.372706 4679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:37.373942 4679 hybrid_clock.cc:648] HybridClock initialized: now 1786372237373904 us; error 54 us; skew 500 ppm
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372237, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:37.377496 4679 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:37.378674 4679 webserver.cc:460] Webserver started at http://127.1.206.66:36397/ using document root <none> and password file <none>
I20260810 14:30:37.379418 4679 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:37.379501 4679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:37.379691 4679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:37.382056 4679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "cfff8de57f17415f89aca07a6ca2b961"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "44465f83edd23a249dadb4a44b0c6d54"
server_key_iv: "1a18a39c1fad51865fd5769db3a2b61d"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.382776 4679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "cfff8de57f17415f89aca07a6ca2b961"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "44465f83edd23a249dadb4a44b0c6d54"
server_key_iv: "1a18a39c1fad51865fd5769db3a2b61d"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.388186 4679 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260810 14:30:37.391098 4694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.392699 4679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:37.392855 4679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "cfff8de57f17415f89aca07a6ca2b961"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "44465f83edd23a249dadb4a44b0c6d54"
server_key_iv: "1a18a39c1fad51865fd5769db3a2b61d"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.393000 4679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:37.408735 4679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:37.412528 4679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:37.412766 4679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:37.413431 4679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:37.414342 4679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:37.414393 4679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.414466 4679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:37.414506 4679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.425349 4679 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:43777
I20260810 14:30:37.425367 4815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:43777 every 8 connection(s)
I20260810 14:30:37.426369 4679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:37.426654 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 4679
I20260810 14:30:37.426733 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:37.427068 1849 external_mini_cluster.cc:1428] Setting key 6e6c75a9c7f8100eb7879e8e6126477e
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372237, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:30:37.443909 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:37.428500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:57629 (local address 127.1.206.126:34007)
0810 14:30:37.428649 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:37.428660 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:37.429899 (+ 1239us) server_negotiation.cc:407] Connection header received
0810 14:30:37.431959 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:37.431963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:37.432027 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:37.432125 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:37.433909 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.434473 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.435897 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.436184 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.436353 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:37.439520 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:37.439524 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:37.439526 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:37.439556 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:37.441488 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:37.442135 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:37.442139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:37.442141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:37.442242 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:37.442636 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:37.442640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:37.442642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:37.442860 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:37.442975 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:37.443610 (+ 635us) server_negotiation.cc:299] Negotiation successful
0810 14:30:37.443767 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 14:30:37.445191 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:37.429054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34007 (local address 127.1.206.66:57629)
0810 14:30:37.429670 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:37.429756 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:37.431688 (+ 1932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:37.432539 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:37.432555 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:37.433118 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:37.433708 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:37.433725 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.434624 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.434627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:37.435748 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:37.435760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.436411 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.436416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:37.436620 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:37.437344 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:37.437363 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:37.439213 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:37.441645 (+ 2432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:37.441651 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:37.441666 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:37.441996 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:37.442356 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:37.442359 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:37.442361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:37.442528 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:37.442976 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:37.442986 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:37.443270 (+ 284us) client_negotiation.cc:769] Sending connection context
0810 14:30:37.443505 (+ 235us) client_negotiation.cc:240] Negotiation successful
0810 14:30:37.443955 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":155,"threads_started":1}
I20260810 14:30:37.446696 4816 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34007
I20260810 14:30:37.447014 4816 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:37.447600 4816 heartbeater.cc:511] Master 127.1.206.126:34007 requested a full tablet report, sending...
I20260810 14:30:37.448961 4468 ts_manager.cc:194] Registered new tserver with Master: cfff8de57f17415f89aca07a6ca2b961 (127.1.206.66:43777)
I20260810 14:30:37.449596 4468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:57629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:37.460665 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34007
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:37.585763 4821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:37.586081 4821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:37.586172 4821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:37.590675 4821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:37.590763 4821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:37.590828 4821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:37.596850 4821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:37.598114 4821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:37.599145 4821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:37.609807 4827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:37.609828 4828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:37.609828 4830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:37.609967 4821 server_base.cc:1034] running on GCE node
I20260810 14:30:37.610651 4821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:37.611394 4821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:37.612587 4821 hybrid_clock.cc:648] HybridClock initialized: now 1786372237612557 us; error 44 us; skew 500 ppm
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4421](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372237, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:37.615607 4821 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:37.616686 4821 webserver.cc:460] Webserver started at http://127.1.206.67:41795/ using document root <none> and password file <none>
I20260810 14:30:37.617265 4821 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:37.617327 4821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:37.617507 4821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:37.619616 4821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "494f2a2327ac4dfd88297b70e52f7b23"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "65993c854b1ad8873130ee8d75786702"
server_key_iv: "8fbf6d150bd7cf3bd4edd2219bab7f18"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.620162 4821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "494f2a2327ac4dfd88297b70e52f7b23"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "65993c854b1ad8873130ee8d75786702"
server_key_iv: "8fbf6d150bd7cf3bd4edd2219bab7f18"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.624089 4821 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:30:37.626824 4837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.628386 4821 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:37.628526 4821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "494f2a2327ac4dfd88297b70e52f7b23"
format_stamp: "Formatted at 2026-08-10 14:30:37 on dist-test-slave-0b58"
server_key: "65993c854b1ad8873130ee8d75786702"
server_key_iv: "8fbf6d150bd7cf3bd4edd2219bab7f18"
server_key_version: "encryptionkey@0"
I20260810 14:30:37.628652 4821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:37.655005 4821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:37.658442 4821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:37.658677 4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:37.659366 4821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:37.660465 4821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:37.660517 4821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.660560 4821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:37.660575 4821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:37.671082 4821 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:38417
I20260810 14:30:37.671211 4958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:38417 every 8 connection(s)
I20260810 14:30:37.672096 4821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:37.679646 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 4821
I20260810 14:30:37.679775 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:37.680097 1849 external_mini_cluster.cc:1428] Setting key 4fb316af6130f2ad1b1ac4a75f524d28
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4421](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372237, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:37.688832 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:37.674185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:42493 (local address 127.1.206.126:34007)
0810 14:30:37.674342 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:37.674346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:37.675285 (+ 939us) server_negotiation.cc:407] Connection header received
0810 14:30:37.676720 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:37.676723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:37.676786 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:37.676905 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:37.678143 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.678696 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.680365 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.680686 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.680806 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:37.684039 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:37.684042 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:37.684044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:37.684073 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:37.686014 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:37.686775 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:37.686778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:37.686779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:37.686873 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:37.687325 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:37.687327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:37.687329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:37.687561 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:37.687653 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:37.688582 (+ 929us) server_negotiation.cc:299] Negotiation successful
0810 14:30:37.688701 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 14:30:37.689649 4961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:37.674592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34007 (local address 127.1.206.67:42493)
0810 14:30:37.675078 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:37.675163 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:37.676491 (+ 1328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:37.677098 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:37.677104 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:37.677481 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:37.677976 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:37.677990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.678831 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.678841 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:37.680125 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:37.680139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:37.680877 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:37.680881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:37.681139 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:37.681999 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:37.682024 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:37.683840 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:37.686180 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:37.686186 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:37.686202 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:37.686610 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:37.687004 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:37.687007 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:37.687008 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:37.687192 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:37.687738 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:37.687745 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:37.688028 (+ 283us) client_negotiation.cc:769] Sending connection context
0810 14:30:37.688226 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 14:30:37.688603 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":133,"threads_started":1}
I20260810 14:30:37.690922 4959 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34007
I20260810 14:30:37.691200 4959 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:37.691740 4959 heartbeater.cc:511] Master 127.1.206.126:34007 requested a full tablet report, sending...
I20260810 14:30:37.692898 4468 ts_manager.cc:194] Registered new tserver with Master: 494f2a2327ac4dfd88297b70e52f7b23 (127.1.206.67:38417)
I20260810 14:30:37.693512 4468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:42493
I20260810 14:30:37.695516 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 14:30:37.710227 4509 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:37.708769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49172 (local address 127.1.206.126:34007)
0810 14:30:37.708905 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:37.708909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:37.709062 (+ 153us) server_negotiation.cc:407] Connection header received
0810 14:30:37.709209 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:37.709212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:37.709257 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:37.709323 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:37.710108 (+ 785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49172: BlockingRecv error: recv got EOF from 127.0.0.1:49172 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 14:30:37.711485 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 4534
I20260810 14:30:37.719908 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 4679
I20260810 14:30:37.726460 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 4821
I20260810 14:30:37.734608 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 4435
2026-08-10T14:30:37Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2348 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4971](info): set up 2 sockets
Aug 10 14:30:37 dist-test-slave-0b58 krb5kdc[4971](info): commencing operation
krb5kdc: starting...
W20260810 14:30:38.822865 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:38 dist-test-slave-0b58 krb5kdc[4971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:38.955616 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45281
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:45281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:39.070777 4984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:39.071151 4984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:39.071239 4984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:39.075428 4984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:39.075536 4984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:39.075578 4984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:39.075618 4984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:39.075655 4984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:39.081578 4984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:45281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:39.082768 4984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:39.083832 4984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:39.092626 4994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:39.092617 4989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:39.092628 4990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:39.093056 4984 server_base.cc:1034] running on GCE node
I20260810 14:30:39.093673 4984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:39.094818 4984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:39.095995 4984 hybrid_clock.cc:648] HybridClock initialized: now 1786372239095976 us; error 31 us; skew 500 ppm
Aug 10 14:30:39 dist-test-slave-0b58 krb5kdc[4971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372239, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:39.105844 4984 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:39.106930 4984 webserver.cc:460] Webserver started at http://127.1.206.126:34611/ using document root <none> and password file <none>
I20260810 14:30:39.107542 4984 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:39.107643 4984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:39.107899 4984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:39.110193 4984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "42f2d101eb8b40159e800c75b1ff1cc0"
format_stamp: "Formatted at 2026-08-10 14:30:39 on dist-test-slave-0b58"
server_key: "2e04f9f44458ad2a475c624415447b3a"
server_key_iv: "bf95dbfe54975664f5b3578d3019259b"
server_key_version: "encryptionkey@0"
I20260810 14:30:39.110827 4984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "42f2d101eb8b40159e800c75b1ff1cc0"
format_stamp: "Formatted at 2026-08-10 14:30:39 on dist-test-slave-0b58"
server_key: "2e04f9f44458ad2a475c624415447b3a"
server_key_iv: "bf95dbfe54975664f5b3578d3019259b"
server_key_version: "encryptionkey@0"
I20260810 14:30:39.115126 4984 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:39.117856 5001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:39.119163 4984 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:30:39.119336 4984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "42f2d101eb8b40159e800c75b1ff1cc0"
format_stamp: "Formatted at 2026-08-10 14:30:39 on dist-test-slave-0b58"
server_key: "2e04f9f44458ad2a475c624415447b3a"
server_key_iv: "bf95dbfe54975664f5b3578d3019259b"
server_key_version: "encryptionkey@0"
I20260810 14:30:39.119467 4984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:39.141072 4984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:39.144187 4984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:39.144470 4984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:39.151839 4984 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:45281
I20260810 14:30:39.152194 5060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:45281 every 8 connection(s)
I20260810 14:30:39.152925 4984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:39.153614 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 4984
I20260810 14:30:39.153766 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:39.154054 1849 external_mini_cluster.cc:1428] Setting key 042ed3de6e7287006d76486e3f6e5110
I20260810 14:30:39.156692 5061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:39.163872 5061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0: Bootstrap starting.
Aug 10 14:30:39 dist-test-slave-0b58 krb5kdc[4971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:39.166958 5061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:39.167949 5061 log.cc:824] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:39.170264 5061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0: No bootstrap required, opened a new log
I20260810 14:30:39.170418 5064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:39.155482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48680 (local address 127.1.206.126:45281)
0810 14:30:39.156210 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:39.156232 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:39.156301 (+ 69us) server_negotiation.cc:407] Connection header received
0810 14:30:39.157234 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:39.157259 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:39.157677 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:39.158086 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:39.158867 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:39.160457 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:39.161388 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:39.162107 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:39.162275 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:39.165120 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:39.165128 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:39.165148 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:39.165190 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:39.167281 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:39.167751 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:39.167758 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:39.167764 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:39.167917 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:39.168234 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:39.168237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:39.168239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:39.168767 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:39.169003 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:39.169327 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 14:30:39.169643 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":396,"threads_started":1}
I20260810 14:30:39.173645 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:30:39.174678 5061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45281 } }
I20260810 14:30:39.174952 5061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:39.175032 5061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42f2d101eb8b40159e800c75b1ff1cc0, State: Initialized, Role: FOLLOWER
I20260810 14:30:39.175518 5061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45281 } }
I20260810 14:30:39.175681 5061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:39.175769 5061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:39.175876 5061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:39.177008 5061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45281 } }
I20260810 14:30:39.177420 5061 leader_election.cc:302] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42f2d101eb8b40159e800c75b1ff1cc0; no voters:
I20260810 14:30:39.177831 5061 leader_election.cc:288] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:39.177958 5067 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:39.178215 5067 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [term 1 LEADER]: Becoming Leader. State: Replica: 42f2d101eb8b40159e800c75b1ff1cc0, State: Running, Role: LEADER
I20260810 14:30:39.178613 5067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45281 } }
I20260810 14:30:39.179385 5061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:39.180300 5068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45281 } } }
I20260810 14:30:39.180435 5068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:39.180824 5069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42f2d101eb8b40159e800c75b1ff1cc0. Latest consensus state: current_term: 1 leader_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2d101eb8b40159e800c75b1ff1cc0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45281 } } }
I20260810 14:30:39.180917 5069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:39.182468 5076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:39.185380 5076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:39.191411 5076 catalog_manager.cc:1347] Generated new cluster ID: d1bf2594cfea443f8a08a641376f6639
I20260810 14:30:39.191516 5076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:39.195988 5064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:39.190555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48682 (local address 127.1.206.126:45281)
0810 14:30:39.190670 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:39.190675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:39.191023 (+ 348us) server_negotiation.cc:407] Connection header received
0810 14:30:39.191275 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:39.191284 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:39.191343 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:39.191445 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:39.192159 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:39.192796 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:39.193688 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:39.193944 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:39.194058 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:39.195003 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:39.195006 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:39.195008 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:39.195465 (+ 457us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:39.195495 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:39.195511 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:39.195618 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:39.195748 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:30:39.195816 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:30:39.201977 5076 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:39.203028 5076 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:39.215653 5076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42f2d101eb8b40159e800c75b1ff1cc0: Generated new TSK 0
I20260810 14:30:39.216692 5076 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:30:39.226754 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 4984
2026-08-10T14:30:39Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1490 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:39 dist-test-slave-0b58 krb5kdc[5097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:39 dist-test-slave-0b58 krb5kdc[5097](info): set up 2 sockets
Aug 10 14:30:39 dist-test-slave-0b58 krb5kdc[5097](info): commencing operation
krb5kdc: starting...
W20260810 14:30:40.405053 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260810 14:30:40.541864 1849 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.137s user 0.001s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260810 14:30:40.707846 1849 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.166s user 0.001s sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260810 14:30:40.895388 1849 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.187s user 0.000s sys 0.003s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/test-user.keytab.
W20260810 14:30:41.056422 1849 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.161s user 0.000s sys 0.002s
Aug 10 14:30:41 dist-test-slave-0b58 krb5kdc[5097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:41.110823 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39785
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:39309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39785
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:41.232522 5112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:41.232934 5112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:41.233039 5112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:41.238269 5112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:41.238389 5112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:41.238430 5112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:41.238471 5112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:41.238529 5112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:41.245151 5112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:39309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:41.246434 5112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:41.247670 5112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:41.257124 5119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:41.257220 5112 server_base.cc:1034] running on GCE node
W20260810 14:30:41.257114 5118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:41.257124 5121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:41.257997 5112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:41.259220 5112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:41.260411 5112 hybrid_clock.cc:648] HybridClock initialized: now 1786372241260396 us; error 29 us; skew 500 ppm
Aug 10 14:30:41 dist-test-slave-0b58 krb5kdc[5097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372241, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:41.263633 5112 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:41.264747 5112 webserver.cc:460] Webserver started at http://127.1.206.126:39365/ using document root <none> and password file <none>
I20260810 14:30:41.265347 5112 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:41.265440 5112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:41.265683 5112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:41.267943 5112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "0ceae8c7f4fd47639b83681ace8486e5"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "e57f10b1e000016f58802725c2f5bd18"
server_key_iv: "6c04b7c607ed71ebea82979e4913f985"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.268682 5112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "0ceae8c7f4fd47639b83681ace8486e5"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "e57f10b1e000016f58802725c2f5bd18"
server_key_iv: "6c04b7c607ed71ebea82979e4913f985"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.272924 5112 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 14:30:41.275645 5129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:41.277154 5112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:41.277287 5112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "0ceae8c7f4fd47639b83681ace8486e5"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "e57f10b1e000016f58802725c2f5bd18"
server_key_iv: "6c04b7c607ed71ebea82979e4913f985"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.277398 5112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:41.294941 5112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:41.298679 5112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:41.298861 5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:41.306540 5112 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39785
I20260810 14:30:41.306905 5184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39785 every 8 connection(s)
I20260810 14:30:41.307657 5112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:41.308952 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 5112
I20260810 14:30:41.309087 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:41.309391 1849 external_mini_cluster.cc:1428] Setting key cf553a9bca2a2b4572aa0d0fe8df9732
I20260810 14:30:41.311441 5185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:41.317471 5185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5: Bootstrap starting.
Aug 10 14:30:41 dist-test-slave-0b58 krb5kdc[5097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372241, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:41.320298 5185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:41.321249 5185 log.cc:824] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:41.323774 5185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5: No bootstrap required, opened a new log
I20260810 14:30:41.325158 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:41.310965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42314 (local address 127.1.206.126:39785)
0810 14:30:41.311528 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:41.311553 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:41.311610 (+ 57us) server_negotiation.cc:407] Connection header received
0810 14:30:41.312391 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:41.312410 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:41.312773 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:41.313132 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:41.314029 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.315062 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.315993 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.316577 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.316764 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:41.319729 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:41.319734 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:41.319749 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:41.319780 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:41.321723 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:41.322297 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:41.322304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:41.322311 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:41.322454 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:41.322736 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:41.322739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:41.322741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:41.323282 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:41.323471 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:41.323718 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 14:30:41.324085 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":153,"threads_started":1}
I20260810 14:30:41.328384 5185 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ceae8c7f4fd47639b83681ace8486e5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39785 } }
I20260810 14:30:41.328621 5185 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:41.328655 5185 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ceae8c7f4fd47639b83681ace8486e5, State: Initialized, Role: FOLLOWER
I20260810 14:30:41.329092 5185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ceae8c7f4fd47639b83681ace8486e5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39785 } }
I20260810 14:30:41.329279 5185 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:41.329357 5185 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:41.329448 5185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:41.330549 5185 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ceae8c7f4fd47639b83681ace8486e5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39785 } }
I20260810 14:30:41.330912 5185 leader_election.cc:302] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ceae8c7f4fd47639b83681ace8486e5; no voters:
I20260810 14:30:41.331271 5185 leader_election.cc:288] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:41.331444 5191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:41.331701 5191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [term 1 LEADER]: Becoming Leader. State: Replica: 0ceae8c7f4fd47639b83681ace8486e5, State: Running, Role: LEADER
I20260810 14:30:41.332084 5191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ceae8c7f4fd47639b83681ace8486e5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39785 } }
I20260810 14:30:41.332683 5185 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:41.333981 5192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ceae8c7f4fd47639b83681ace8486e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ceae8c7f4fd47639b83681ace8486e5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39785 } } }
I20260810 14:30:41.334017 5193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ceae8c7f4fd47639b83681ace8486e5. Latest consensus state: current_term: 1 leader_uuid: "0ceae8c7f4fd47639b83681ace8486e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ceae8c7f4fd47639b83681ace8486e5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39785 } } }
I20260810 14:30:41.334108 5192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:41.334136 5193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:41.334506 5201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:41.337510 5201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:41.342824 5201 catalog_manager.cc:1347] Generated new cluster ID: fcb2c586f3b243aea6b349206015c846
I20260810 14:30:41.342900 5201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:41.373296 5201 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:41.374369 5201 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:41.381668 5201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ceae8c7f4fd47639b83681ace8486e5: Generated new TSK 0
I20260810 14:30:41.382513 5201 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:41.415509 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39785
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:39309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:41.541576 5215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:41.541874 5215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:41.541920 5215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:41.546181 5215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:41.546262 5215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:41.546325 5215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:41.552175 5215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:39309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:41.553462 5215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:41.554519 5215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:41.564661 5223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:41.564669 5221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:41.564687 5220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:41.565054 5215 server_base.cc:1034] running on GCE node
I20260810 14:30:41.565506 5215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:41.566185 5215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:41.567374 5215 hybrid_clock.cc:648] HybridClock initialized: now 1786372241567355 us; error 32 us; skew 500 ppm
Aug 10 14:30:41 dist-test-slave-0b58 krb5kdc[5097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372241, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:41.570767 5215 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:41.571762 5215 webserver.cc:460] Webserver started at http://127.1.206.65:35169/ using document root <none> and password file <none>
I20260810 14:30:41.572468 5215 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:41.572573 5215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:41.572827 5215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:41.575192 5215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "b9c25ccc32ea4612840df2a80158015f"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "ff688f0a8231cac42007947330e7980d"
server_key_iv: "cc07a986d3c5483058f6bf526f93bfe8"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.575877 5215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "b9c25ccc32ea4612840df2a80158015f"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "ff688f0a8231cac42007947330e7980d"
server_key_iv: "cc07a986d3c5483058f6bf526f93bfe8"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.580145 5215 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260810 14:30:41.583052 5230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:41.584575 5215 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:41.584719 5215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "b9c25ccc32ea4612840df2a80158015f"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "ff688f0a8231cac42007947330e7980d"
server_key_iv: "cc07a986d3c5483058f6bf526f93bfe8"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.584852 5215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:41.599586 5215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:41.603179 5215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:41.603516 5215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:41.604195 5215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:41.605131 5215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:41.605211 5215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:41.605284 5215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:41.605335 5215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:41.614950 5215 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:45295
I20260810 14:30:41.614974 5350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:45295 every 8 connection(s)
I20260810 14:30:41.615947 5215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:41.624550 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 5215
I20260810 14:30:41.624711 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:41.625047 1849 external_mini_cluster.cc:1428] Setting key d542a520a81be0ee0a2dbe591acdb227
Aug 10 14:30:41 dist-test-slave-0b58 krb5kdc[5097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372241, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:41.632347 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:41.617903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:48577 (local address 127.1.206.126:39785)
0810 14:30:41.618053 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:41.618057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:41.618970 (+ 913us) server_negotiation.cc:407] Connection header received
0810 14:30:41.620576 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:41.620580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:41.620647 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:41.620736 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:41.622070 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.622644 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.623952 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.624210 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.624384 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:41.627452 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:41.627459 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:41.627465 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:41.627504 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:41.629468 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:41.630259 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:41.630262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:41.630263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:41.630381 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:41.630830 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:41.630836 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:41.630841 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:41.631128 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:41.631243 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:41.631804 (+ 561us) server_negotiation.cc:299] Negotiation successful
0810 14:30:41.631991 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:30:41.633241 5353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:41.618286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39785 (local address 127.1.206.65:48577)
0810 14:30:41.618794 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:41.618843 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:41.620322 (+ 1479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:41.620960 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:41.620967 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:41.621365 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:41.621892 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:41.621907 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.622819 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.622823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:41.623797 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:41.623810 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.624436 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.624440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:41.624673 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:41.625459 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:41.625478 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:41.627243 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:41.629622 (+ 2379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:41.629632 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:41.629656 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:41.630135 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:41.630492 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:41.630498 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:41.630502 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:41.630723 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:41.631250 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:41.631256 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:41.631536 (+ 280us) client_negotiation.cc:769] Sending connection context
0810 14:30:41.631711 (+ 175us) client_negotiation.cc:240] Negotiation successful
0810 14:30:41.632040 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":131,"threads_started":1}
I20260810 14:30:41.634886 5351 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39785
I20260810 14:30:41.635169 5351 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:41.635675 5351 heartbeater.cc:511] Master 127.1.206.126:39785 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:30:41.637600 5148 ts_manager.cc:194] Registered new tserver with Master: b9c25ccc32ea4612840df2a80158015f (127.1.206.65:45295)
I20260810 14:30:41.638823 5148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:48577
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:41.660420 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39785
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:39309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:41.777627 5356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:41.777935 5356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:41.778034 5356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:41.782426 5356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:41.782517 5356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:41.782606 5356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:41.788408 5356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:39309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:41.789690 5356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:41.790887 5356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:41.801453 5363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:41.801456 5361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:41.801532 5365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:41.801779 5356 server_base.cc:1034] running on GCE node
I20260810 14:30:41.802392 5356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:41.803180 5356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:41.804381 5356 hybrid_clock.cc:648] HybridClock initialized: now 1786372241804364 us; error 39 us; skew 500 ppm
Aug 10 14:30:41 dist-test-slave-0b58 krb5kdc[5097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372241, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:41.807509 5356 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:41.808671 5356 webserver.cc:460] Webserver started at http://127.1.206.66:41467/ using document root <none> and password file <none>
I20260810 14:30:41.809326 5356 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:41.809430 5356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:41.809684 5356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:41.811897 5356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "ca993966104240779a50f0b6eb32735d"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "4fec52d735a623d63758312aa48599ed"
server_key_iv: "6bf7eaf9b169f0c94b3be4840baa3f0b"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.812568 5356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "ca993966104240779a50f0b6eb32735d"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "4fec52d735a623d63758312aa48599ed"
server_key_iv: "6bf7eaf9b169f0c94b3be4840baa3f0b"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.816794 5356 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:30:41.819675 5373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:41.821193 5356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:41.821368 5356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "ca993966104240779a50f0b6eb32735d"
format_stamp: "Formatted at 2026-08-10 14:30:41 on dist-test-slave-0b58"
server_key: "4fec52d735a623d63758312aa48599ed"
server_key_iv: "6bf7eaf9b169f0c94b3be4840baa3f0b"
server_key_version: "encryptionkey@0"
I20260810 14:30:41.821519 5356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:41.840521 5356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:41.843622 5356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:41.843844 5356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:41.844542 5356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:41.845391 5356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:41.845463 5356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:41.845536 5356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:41.845588 5356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:41.855248 5356 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:40057
I20260810 14:30:41.855273 5495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:40057 every 8 connection(s)
I20260810 14:30:41.856196 5356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:41.858667 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 5356
I20260810 14:30:41.858803 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:41.859127 1849 external_mini_cluster.cc:1428] Setting key 65c678fd1f8c09fc1d721b008eafb3c7
Aug 10 14:30:41 dist-test-slave-0b58 krb5kdc[5097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372241, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:41.872820 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:41.858209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:38997 (local address 127.1.206.126:39785)
0810 14:30:41.858356 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:41.858361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:41.859921 (+ 1560us) server_negotiation.cc:407] Connection header received
0810 14:30:41.861573 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:41.861581 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:41.861648 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:41.861746 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:41.862991 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.863864 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.865117 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.865395 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.865540 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:41.868789 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:41.868792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:41.868794 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:41.868821 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:41.870492 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:41.871154 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:41.871156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:41.871158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:41.871235 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:41.871671 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:41.871673 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:41.871674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:41.871866 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:41.871945 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:41.872568 (+ 623us) server_negotiation.cc:299] Negotiation successful
0810 14:30:41.872687 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:30:41.873649 5498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:41.858592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39785 (local address 127.1.206.66:38997)
0810 14:30:41.859761 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:41.859816 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:41.861348 (+ 1532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:41.861916 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:41.861923 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:41.862347 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:41.862852 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:41.862866 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.864013 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.864015 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:41.865002 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:41.865011 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:41.865597 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:41.865603 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:41.865882 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:41.866558 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:41.866585 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:41.868578 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:41.870623 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:41.870634 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:41.870655 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:41.871046 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:41.871349 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:41.871354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:41.871358 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:41.871565 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:41.871963 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:41.871968 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:41.872315 (+ 347us) client_negotiation.cc:769] Sending connection context
0810 14:30:41.872485 (+ 170us) client_negotiation.cc:240] Negotiation successful
0810 14:30:41.872772 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":164,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:30:41.875026 5496 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39785
I20260810 14:30:41.875308 5496 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:41.875833 5496 heartbeater.cc:511] Master 127.1.206.126:39785 requested a full tablet report, sending...
I20260810 14:30:41.877044 5148 ts_manager.cc:194] Registered new tserver with Master: ca993966104240779a50f0b6eb32735d (127.1.206.66:40057)
I20260810 14:30:41.877964 5148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:38997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:41.891958 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39785
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:39309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:42.009958 5501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:42.010260 5501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:42.010306 5501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:42.014381 5501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:42.014449 5501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:42.014511 5501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:42.019870 5501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:39309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:42.020991 5501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:42.021996 5501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:42.032202 5507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:42.032207 5508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:42.032374 5501 server_base.cc:1034] running on GCE node
W20260810 14:30:42.032202 5510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:42.033057 5501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:42.033900 5501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:42.035081 5501 hybrid_clock.cc:648] HybridClock initialized: now 1786372242035041 us; error 53 us; skew 500 ppm
Aug 10 14:30:42 dist-test-slave-0b58 krb5kdc[5097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372242, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:42.038427 5501 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:42.039561 5501 webserver.cc:460] Webserver started at http://127.1.206.67:39677/ using document root <none> and password file <none>
I20260810 14:30:42.040223 5501 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:42.040403 5501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:42.040668 5501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:42.042928 5501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "aca9e8f38abb4a90b559d1d0fd1e74bb"
format_stamp: "Formatted at 2026-08-10 14:30:42 on dist-test-slave-0b58"
server_key: "9ead48a638b0bf4d367fe6b9d094b936"
server_key_iv: "e538fffa3619048734ee1bc675ce4d02"
server_key_version: "encryptionkey@0"
I20260810 14:30:42.043536 5501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "aca9e8f38abb4a90b559d1d0fd1e74bb"
format_stamp: "Formatted at 2026-08-10 14:30:42 on dist-test-slave-0b58"
server_key: "9ead48a638b0bf4d367fe6b9d094b936"
server_key_iv: "e538fffa3619048734ee1bc675ce4d02"
server_key_version: "encryptionkey@0"
I20260810 14:30:42.047663 5501 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:42.050501 5518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:42.051870 5501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:42.052023 5501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "aca9e8f38abb4a90b559d1d0fd1e74bb"
format_stamp: "Formatted at 2026-08-10 14:30:42 on dist-test-slave-0b58"
server_key: "9ead48a638b0bf4d367fe6b9d094b936"
server_key_iv: "e538fffa3619048734ee1bc675ce4d02"
server_key_version: "encryptionkey@0"
I20260810 14:30:42.052150 5501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:42.063023 5501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:42.066453 5501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:42.066674 5501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:42.067306 5501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:42.068204 5501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:42.068342 5501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:42.068426 5501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:42.068480 5501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:42.078349 5501 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:41901
I20260810 14:30:42.078393 5637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:41901 every 8 connection(s)
I20260810 14:30:42.079358 5501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:42.079712 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 5501
I20260810 14:30:42.079854 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:42.080206 1849 external_mini_cluster.cc:1428] Setting key b487628c129a95671c55cc93fabe931c
Aug 10 14:30:42 dist-test-slave-0b58 krb5kdc[5097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372242, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:42.093811 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:42.081373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:49655 (local address 127.1.206.126:39785)
0810 14:30:42.081514 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:42.081519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:42.082536 (+ 1017us) server_negotiation.cc:407] Connection header received
0810 14:30:42.084141 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:42.084144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:42.084191 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:42.084331 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:42.085506 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:42.086026 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:42.087167 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:42.087397 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:42.087475 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:42.090214 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:42.090217 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:42.090219 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:42.090247 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:42.091611 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:42.092123 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:42.092126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:42.092127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:42.092206 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:42.092604 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:42.092607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:42.092608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:42.092800 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:42.092879 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:42.093449 (+ 570us) server_negotiation.cc:299] Negotiation successful
0810 14:30:42.093611 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 14:30:42.094936 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:42.081857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39785 (local address 127.1.206.67:49655)
0810 14:30:42.082376 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:42.082441 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:42.083925 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:42.084484 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:42.084490 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:42.084874 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:42.085372 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:42.085386 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:42.086146 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:42.086148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:42.087057 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:42.087067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:42.087530 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:42.087533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:42.087682 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:42.088447 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:42.088474 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:42.090036 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:42.091730 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:42.091735 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:42.091748 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:42.092032 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:42.092375 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:42.092377 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:42.092378 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:42.092520 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:42.092911 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:42.092918 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:42.093205 (+ 287us) client_negotiation.cc:769] Sending connection context
0810 14:30:42.093424 (+ 219us) client_negotiation.cc:240] Negotiation successful
0810 14:30:42.093823 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":121,"threads_started":1}
I20260810 14:30:42.096164 5638 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39785
I20260810 14:30:42.096472 5638 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:42.097003 5638 heartbeater.cc:511] Master 127.1.206.126:39785 requested a full tablet report, sending...
I20260810 14:30:42.098093 5148 ts_manager.cc:194] Registered new tserver with Master: aca9e8f38abb4a90b559d1d0fd1e74bb (127.1.206.67:41901)
I20260810 14:30:42.098672 5148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:49655
I20260810 14:30:42.106961 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:30:42 dist-test-slave-0b58 krb5kdc[5097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372242, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 14:30:42 dist-test-slave-0b58 krb5kdc[5097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372242, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:42.136314 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:42.126646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42316 (local address 127.1.206.126:39785)
0810 14:30:42.126797 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:42.126801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:42.126908 (+ 107us) server_negotiation.cc:407] Connection header received
0810 14:30:42.127016 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:42.127018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:42.127064 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:42.127160 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:42.128010 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:42.128623 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:42.129568 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:42.129809 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:42.129908 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:42.132737 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:42.132741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:42.132743 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:42.132790 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:42.134331 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:42.134908 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:42.134911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:42.134912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:42.135000 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:42.135346 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:42.135349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:42.135350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:42.135602 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:42.135720 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:42.135969 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 14:30:42.136080 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 14:30:42.136926 5148 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42316
I20260810 14:30:42.137857 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 5215
I20260810 14:30:42.147325 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 5356
I20260810 14:30:42.154138 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 5501
I20260810 14:30:42.163215 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 5112
2026-08-10T14:30:42Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2938 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:42 dist-test-slave-0b58 krb5kdc[5651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:42 dist-test-slave-0b58 krb5kdc[5651](info): set up 2 sockets
Aug 10 14:30:42 dist-test-slave-0b58 krb5kdc[5651](info): commencing operation
krb5kdc: starting...
W20260810 14:30:43.319543 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:43 dist-test-slave-0b58 krb5kdc[5651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:43.453603 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:37479
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:37479
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:43.567567 5664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:43.567875 5664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:43.567917 5664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:43.572024 5664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:43.572101 5664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:43.572121 5664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:43.572139 5664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:43.572154 5664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:43.577999 5664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:37479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:37479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:43.579068 5664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:43.580066 5664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:43.588948 5672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:43.589025 5664 server_base.cc:1034] running on GCE node
W20260810 14:30:43.588966 5670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:43.588999 5674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:43.589865 5664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:43.590966 5664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:43.592075 5664 hybrid_clock.cc:648] HybridClock initialized: now 1786372243592005 us; error 90 us; skew 500 ppm
Aug 10 14:30:43 dist-test-slave-0b58 krb5kdc[5651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:43.595005 5664 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:43.595918 5664 webserver.cc:460] Webserver started at http://127.1.206.126:45605/ using document root <none> and password file <none>
I20260810 14:30:43.596515 5664 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:43.596582 5664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:43.596750 5664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:43.598824 5664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "376bace9b6274cef9f05b1988f176fb0"
format_stamp: "Formatted at 2026-08-10 14:30:43 on dist-test-slave-0b58"
server_key: "3287618ba63f78644596eb625e3d4e13"
server_key_iv: "205a637cd858f75acc222af83a8809bb"
server_key_version: "encryptionkey@0"
I20260810 14:30:43.599365 5664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "376bace9b6274cef9f05b1988f176fb0"
format_stamp: "Formatted at 2026-08-10 14:30:43 on dist-test-slave-0b58"
server_key: "3287618ba63f78644596eb625e3d4e13"
server_key_iv: "205a637cd858f75acc222af83a8809bb"
server_key_version: "encryptionkey@0"
I20260810 14:30:43.603160 5664 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:43.605558 5681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:43.606781 5664 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:30:43.606940 5664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "376bace9b6274cef9f05b1988f176fb0"
format_stamp: "Formatted at 2026-08-10 14:30:43 on dist-test-slave-0b58"
server_key: "3287618ba63f78644596eb625e3d4e13"
server_key_iv: "205a637cd858f75acc222af83a8809bb"
server_key_version: "encryptionkey@0"
I20260810 14:30:43.607061 5664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:43.617448 5664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:43.620250 5664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:43.620519 5664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:43.627709 5664 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:37479
I20260810 14:30:43.627720 5739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:37479 every 8 connection(s)
I20260810 14:30:43.628738 5664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:43.630537 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 5664
I20260810 14:30:43.630676 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:43.630970 1849 external_mini_cluster.cc:1428] Setting key 18ad4ba18c15524e6fbcc14874176439
I20260810 14:30:43.631752 5740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:43.638600 5740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0: Bootstrap starting.
Aug 10 14:30:43 dist-test-slave-0b58 krb5kdc[5651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:43.641335 5740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:43.642217 5740 log.cc:824] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:43.644537 5740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0: No bootstrap required, opened a new log
I20260810 14:30:43.645493 5743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:43.632332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46186 (local address 127.1.206.126:37479)
0810 14:30:43.632763 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:43.632779 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:43.632821 (+ 42us) server_negotiation.cc:407] Connection header received
0810 14:30:43.633452 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:43.633468 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:43.633774 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:43.634069 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:43.635025 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:43.636034 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:43.637230 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:43.637698 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:43.637826 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:43.640676 (+ 2850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:43.640681 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:43.640694 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:43.640723 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:43.642660 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:43.643163 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:43.643169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:43.643173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:43.643284 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:43.643583 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:43.643585 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:43.643587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:43.643991 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:43.644142 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:43.644483 (+ 341us) server_negotiation.cc:299] Negotiation successful
0810 14:30:43.644786 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":143,"threads_started":1}
I20260810 14:30:43.648698 5740 raft_consensus.cc:348] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376bace9b6274cef9f05b1988f176fb0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37479 } }
I20260810 14:30:43.648957 5740 raft_consensus.cc:374] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:43.649020 5740 raft_consensus.cc:729] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376bace9b6274cef9f05b1988f176fb0, State: Initialized, Role: FOLLOWER
I20260810 14:30:43.649494 5740 consensus_queue.cc:260] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376bace9b6274cef9f05b1988f176fb0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37479 } }
I20260810 14:30:43.649655 5740 raft_consensus.cc:388] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:43.649729 5740 raft_consensus.cc:482] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:43.649849 5740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:43.650754 5740 raft_consensus.cc:504] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376bace9b6274cef9f05b1988f176fb0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37479 } }
I20260810 14:30:43.651072 5740 leader_election.cc:302] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 376bace9b6274cef9f05b1988f176fb0; no voters:
I20260810 14:30:43.651342 5740 leader_election.cc:288] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:43.651473 5745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:43.651739 5745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [term 1 LEADER]: Becoming Leader. State: Replica: 376bace9b6274cef9f05b1988f176fb0, State: Running, Role: LEADER
I20260810 14:30:43.652114 5745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376bace9b6274cef9f05b1988f176fb0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37479 } }
I20260810 14:30:43.652720 5740 sys_catalog.cc:564] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:43.653824 5746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "376bace9b6274cef9f05b1988f176fb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376bace9b6274cef9f05b1988f176fb0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37479 } } }
I20260810 14:30:43.653981 5746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:43.654261 5747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 376bace9b6274cef9f05b1988f176fb0. Latest consensus state: current_term: 1 leader_uuid: "376bace9b6274cef9f05b1988f176fb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376bace9b6274cef9f05b1988f176fb0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37479 } } }
I20260810 14:30:43.654357 5747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:43.654446 5755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:43.657655 5755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:43.672355 5755 catalog_manager.cc:1347] Generated new cluster ID: bddd760702864381aad12f774703d070
I20260810 14:30:43.672461 5755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:43.698596 5755 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:43.699648 5755 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:43.713888 5755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 376bace9b6274cef9f05b1988f176fb0: Generated new TSK 0
I20260810 14:30:43.714690 5755 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:43.756999 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37479
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:43.872455 5768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:43.872771 5768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:43.872854 5768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:43.877846 5768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:43.877943 5768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:43.878046 5768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:43.883387 5768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:43.884534 5768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:43.885561 5768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:43.895112 5773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:43.895226 5768 server_base.cc:1034] running on GCE node
W20260810 14:30:43.895130 5775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:43.895135 5777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:43.895763 5768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:43.896497 5768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:43.897675 5768 hybrid_clock.cc:648] HybridClock initialized: now 1786372243897648 us; error 41 us; skew 500 ppm
Aug 10 14:30:43 dist-test-slave-0b58 krb5kdc[5651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:43.900695 5768 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:43.901600 5768 webserver.cc:460] Webserver started at http://127.1.206.65:46657/ using document root <none> and password file <none>
I20260810 14:30:43.902174 5768 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:43.902238 5768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:43.902515 5768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:43.904718 5768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "2d79c519b9484fa1904ba45f584427e7"
format_stamp: "Formatted at 2026-08-10 14:30:43 on dist-test-slave-0b58"
server_key: "02c806cb83b92c7df5ef07c53d04922e"
server_key_iv: "ed412e44ed30b0ad7316173de8e0389e"
server_key_version: "encryptionkey@0"
I20260810 14:30:43.905318 5768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "2d79c519b9484fa1904ba45f584427e7"
format_stamp: "Formatted at 2026-08-10 14:30:43 on dist-test-slave-0b58"
server_key: "02c806cb83b92c7df5ef07c53d04922e"
server_key_iv: "ed412e44ed30b0ad7316173de8e0389e"
server_key_version: "encryptionkey@0"
I20260810 14:30:43.909433 5768 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 14:30:43.912129 5784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:43.913394 5768 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:43.913550 5768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "2d79c519b9484fa1904ba45f584427e7"
format_stamp: "Formatted at 2026-08-10 14:30:43 on dist-test-slave-0b58"
server_key: "02c806cb83b92c7df5ef07c53d04922e"
server_key_iv: "ed412e44ed30b0ad7316173de8e0389e"
server_key_version: "encryptionkey@0"
I20260810 14:30:43.913671 5768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:43.937973 5768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:43.941609 5768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:43.941850 5768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:43.942509 5768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:43.943388 5768 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:43.943462 5768 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:43.943536 5768 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:43.943580 5768 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:43.953066 5768 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:45031
I20260810 14:30:43.953140 5912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:45031 every 8 connection(s)
I20260810 14:30:43.954161 5768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:43.955041 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 5768
I20260810 14:30:43.955219 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:43.955538 1849 external_mini_cluster.cc:1428] Setting key 28e22ce1a9930657dfc52def172eb804
Aug 10 14:30:43 dist-test-slave-0b58 krb5kdc[5651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372243, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:30:43.970167 5743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:43.956238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:55973 (local address 127.1.206.126:37479)
0810 14:30:43.956399 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:43.956404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:43.957463 (+ 1059us) server_negotiation.cc:407] Connection header received
0810 14:30:43.959560 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:43.959563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:43.959612 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:43.959677 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:43.960962 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:43.961520 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:43.962824 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:43.963070 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:43.963193 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:43.966002 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:43.966006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:43.966008 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:43.966036 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:43.967673 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:43.968284 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:43.968288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:43.968290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:43.968398 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:43.968783 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:43.968787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:43.968788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:43.969050 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:43.969168 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:43.969894 (+ 726us) server_negotiation.cc:299] Negotiation successful
0810 14:30:43.970032 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 14:30:43.971457 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:43.956722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:37479 (local address 127.1.206.65:55973)
0810 14:30:43.957302 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:43.957348 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:43.959315 (+ 1967us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:43.959879 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:43.959886 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:43.960246 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:43.960807 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:43.960821 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:43.961687 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:43.961689 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:43.962693 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:43.962703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:43.963239 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:43.963243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:43.963428 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:43.964148 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:43.964165 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:43.965784 (+ 1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:43.967838 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:43.967844 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:43.967859 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:43.968143 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:43.968504 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:43.968509 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:43.968516 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:43.968671 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:43.969169 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:43.969179 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:43.969579 (+ 400us) client_negotiation.cc:769] Sending connection context
0810 14:30:43.969806 (+ 227us) client_negotiation.cc:240] Negotiation successful
0810 14:30:43.970236 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":151,"threads_started":1}
I20260810 14:30:43.973060 5913 heartbeater.cc:347] Connected to a master server at 127.1.206.126:37479
I20260810 14:30:43.973356 5913 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:43.973904 5913 heartbeater.cc:511] Master 127.1.206.126:37479 requested a full tablet report, sending...
I20260810 14:30:43.975898 5700 ts_manager.cc:194] Registered new tserver with Master: 2d79c519b9484fa1904ba45f584427e7 (127.1.206.65:45031)
I20260810 14:30:43.977759 5700 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:55973
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:43.988066 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37479
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:44.103837 5919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:44.104144 5919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:44.104190 5919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:44.108763 5919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:44.108845 5919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:44.108908 5919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:44.114526 5919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:44.115680 5919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:44.116834 5919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:44.126775 5925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:44.126775 5924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:44.126812 5927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:44.127058 5919 server_base.cc:1034] running on GCE node
I20260810 14:30:44.127697 5919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:44.128358 5919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:44.129531 5919 hybrid_clock.cc:648] HybridClock initialized: now 1786372244129518 us; error 27 us; skew 500 ppm
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[5651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372244, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:44.138420 5919 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:44.139331 5919 webserver.cc:460] Webserver started at http://127.1.206.66:46863/ using document root <none> and password file <none>
I20260810 14:30:44.139868 5919 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:44.139925 5919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:44.140089 5919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:44.142215 5919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "a4cd3733d96042a994d31fe9cd7c4050"
format_stamp: "Formatted at 2026-08-10 14:30:44 on dist-test-slave-0b58"
server_key: "170291c22e26dfa0ea74a03522cec59b"
server_key_iv: "0fc26be85012e92b6585d998d0370f56"
server_key_version: "encryptionkey@0"
I20260810 14:30:44.142726 5919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "a4cd3733d96042a994d31fe9cd7c4050"
format_stamp: "Formatted at 2026-08-10 14:30:44 on dist-test-slave-0b58"
server_key: "170291c22e26dfa0ea74a03522cec59b"
server_key_iv: "0fc26be85012e92b6585d998d0370f56"
server_key_version: "encryptionkey@0"
I20260810 14:30:44.146554 5919 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:44.149022 5935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:44.150306 5919 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:44.150415 5919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "a4cd3733d96042a994d31fe9cd7c4050"
format_stamp: "Formatted at 2026-08-10 14:30:44 on dist-test-slave-0b58"
server_key: "170291c22e26dfa0ea74a03522cec59b"
server_key_iv: "0fc26be85012e92b6585d998d0370f56"
server_key_version: "encryptionkey@0"
I20260810 14:30:44.150509 5919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:44.176740 5919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:44.179872 5919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:44.180045 5919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:44.180661 5919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:44.181473 5919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:44.181532 5919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:44.181576 5919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:44.181591 5919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:44.190949 5919 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:36435
I20260810 14:30:44.190971 6060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:36435 every 8 connection(s)
I20260810 14:30:44.191876 5919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:44.196125 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 5919
I20260810 14:30:44.196302 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:44.196666 1849 external_mini_cluster.cc:1428] Setting key 3d28bbe8040cf58ac05e8a1f08e4efb1
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[5651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372244, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:44.207038 5743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:44.193764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:37189 (local address 127.1.206.126:37479)
0810 14:30:44.193937 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:44.193942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:44.194815 (+ 873us) server_negotiation.cc:407] Connection header received
0810 14:30:44.196229 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:44.196233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:44.196322 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:44.196420 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:44.197806 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.198471 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.199636 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.199926 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.200054 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:44.203062 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:44.203065 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:44.203067 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:44.203092 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:44.204710 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.205352 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.205354 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.205356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.205435 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.205849 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.205851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.205852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.206023 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:44.206108 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:44.206809 (+ 701us) server_negotiation.cc:299] Negotiation successful
0810 14:30:44.206913 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:44.208163 6063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:44.194181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:37479 (local address 127.1.206.66:37189)
0810 14:30:44.194656 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:44.194702 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:44.196002 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:44.196595 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:44.196602 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:44.197085 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:44.197650 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:44.197664 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.198605 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.198608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:44.199501 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:44.199510 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.200119 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.200123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:44.200337 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:44.200963 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:44.200979 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:44.202849 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:44.204844 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:44.204851 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:44.204868 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:44.205249 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:44.205541 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:44.205546 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:44.205549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:44.205745 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:44.206150 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:44.206161 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:44.206528 (+ 367us) client_negotiation.cc:769] Sending connection context
0810 14:30:44.206771 (+ 243us) client_negotiation.cc:240] Negotiation successful
0810 14:30:44.207250 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":124,"threads_started":1}
I20260810 14:30:44.209554 6061 heartbeater.cc:347] Connected to a master server at 127.1.206.126:37479
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:30:44.209854 6061 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:44.210429 6061 heartbeater.cc:511] Master 127.1.206.126:37479 requested a full tablet report, sending...
I20260810 14:30:44.211604 5700 ts_manager.cc:194] Registered new tserver with Master: a4cd3733d96042a994d31fe9cd7c4050 (127.1.206.66:36435)
I20260810 14:30:44.212239 5700 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:37189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:44.226984 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37479
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:44.347352 6066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:44.347638 6066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:44.347682 6066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:44.351913 6066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:44.352000 6066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:44.352062 6066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:44.357921 6066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:44.359050 6066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:44.360158 6066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:44.370249 6072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:44.370249 6073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:44.370879 6066 server_base.cc:1034] running on GCE node
W20260810 14:30:44.371294 6075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:44.371821 6066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:44.372593 6066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:44.373760 6066 hybrid_clock.cc:648] HybridClock initialized: now 1786372244373746 us; error 56 us; skew 500 ppm
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[5651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372244, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:44.377063 6066 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:44.378084 6066 webserver.cc:460] Webserver started at http://127.1.206.67:41461/ using document root <none> and password file <none>
I20260810 14:30:44.378706 6066 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:44.378815 6066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:44.379065 6066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:44.381356 6066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "210c94aa5c7b44fb9412809eee94f1e8"
format_stamp: "Formatted at 2026-08-10 14:30:44 on dist-test-slave-0b58"
server_key: "a8f59655e72646e5cacb668b9be2c21b"
server_key_iv: "46aca8e23e555c5dfe7633c67f487baa"
server_key_version: "encryptionkey@0"
I20260810 14:30:44.381989 6066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "210c94aa5c7b44fb9412809eee94f1e8"
format_stamp: "Formatted at 2026-08-10 14:30:44 on dist-test-slave-0b58"
server_key: "a8f59655e72646e5cacb668b9be2c21b"
server_key_iv: "46aca8e23e555c5dfe7633c67f487baa"
server_key_version: "encryptionkey@0"
I20260810 14:30:44.386118 6066 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:44.388965 6082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:44.390182 6066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:44.390324 6066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "210c94aa5c7b44fb9412809eee94f1e8"
format_stamp: "Formatted at 2026-08-10 14:30:44 on dist-test-slave-0b58"
server_key: "a8f59655e72646e5cacb668b9be2c21b"
server_key_iv: "46aca8e23e555c5dfe7633c67f487baa"
server_key_version: "encryptionkey@0"
I20260810 14:30:44.390457 6066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:44.408613 6066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:44.412590 6066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:44.412870 6066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:44.413630 6066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:44.414635 6066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:44.414710 6066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:44.414788 6066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:44.414841 6066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:44.428341 6066 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:46393
I20260810 14:30:44.428396 6203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:46393 every 8 connection(s)
I20260810 14:30:44.429308 6066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:44.435590 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 6066
I20260810 14:30:44.435761 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:44.436049 1849 external_mini_cluster.cc:1428] Setting key 82dfbc7fcd0c6ccfe0e14ca1b1c8e831
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[5651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372244, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:44.445251 5743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:44.432170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:46377 (local address 127.1.206.126:37479)
0810 14:30:44.432418 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:44.432423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:44.433611 (+ 1188us) server_negotiation.cc:407] Connection header received
0810 14:30:44.435036 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:44.435038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:44.435087 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:44.435168 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:44.436541 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.437273 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.438772 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.439009 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.439134 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:44.441804 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:44.441808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:44.441810 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:44.441837 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:44.443272 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.443790 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.443793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.443794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.443876 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.444177 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.444179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.444180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.444430 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:44.444511 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:44.445013 (+ 502us) server_negotiation.cc:299] Negotiation successful
0810 14:30:44.445125 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260810 14:30:44.446159 6206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:44.431973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:37479 (local address 127.1.206.67:46377)
0810 14:30:44.433433 (+ 1460us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:44.433496 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:44.434843 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:44.435298 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:44.435304 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:44.435681 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:44.436350 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:44.436377 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.437408 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.437412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:44.438643 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:44.438652 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.439176 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.439180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:44.439334 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:44.440002 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:44.440019 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:44.441631 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:44.443407 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:44.443412 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:44.443425 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:44.443692 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:44.443953 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:44.443955 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:44.443957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:44.444091 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:44.444514 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:44.444520 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:44.444787 (+ 267us) client_negotiation.cc:769] Sending connection context
0810 14:30:44.444949 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 14:30:44.445219 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1225,"thread_start_us":189,"threads_started":1}
I20260810 14:30:44.447400 6204 heartbeater.cc:347] Connected to a master server at 127.1.206.126:37479
I20260810 14:30:44.447636 6204 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:44.448127 6204 heartbeater.cc:511] Master 127.1.206.126:37479 requested a full tablet report, sending...
I20260810 14:30:44.449349 5699 ts_manager.cc:194] Registered new tserver with Master: 210c94aa5c7b44fb9412809eee94f1e8 (127.1.206.67:46393)
I20260810 14:30:44.450126 5699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:46377
I20260810 14:30:44.450136 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[5651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[5651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:44.477918 6211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:44.467985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53180 (local address 127.1.206.65:45031)
0810 14:30:44.468276 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:44.468298 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:44.468333 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:30:44.468390 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:44.468395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:44.468586 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:44.468714 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:44.469419 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.470209 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.471047 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.471436 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.471524 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:44.474046 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:44.474057 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:44.474071 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:44.474098 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:44.475871 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.476401 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.476407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.476408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.476494 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.476817 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.476822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.476828 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.477095 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:44.477328 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:44.477556 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 14:30:44.477730 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":92,"threads_started":1}
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[5651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372244, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:44.489816 5743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:44.480992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46198 (local address 127.1.206.126:37479)
0810 14:30:44.481128 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:44.481135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:44.481223 (+ 88us) server_negotiation.cc:407] Connection header received
0810 14:30:44.481380 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:44.481383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:44.481436 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:44.481523 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:44.482159 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.482725 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.483539 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:44.483784 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:44.483893 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:44.486438 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:44.486442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:44.486445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:44.486482 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:44.487952 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.488505 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.488508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.488509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.488589 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:44.488884 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:44.488887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:44.488889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:44.489126 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:44.489308 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:44.489521 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 14:30:44.489641 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 14:30:44.490288 5699 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46198
I20260810 14:30:44.490999 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 5768
I20260810 14:30:44.500895 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 5919
I20260810 14:30:44.508910 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 6066
I20260810 14:30:44.516150 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 5664
2026-08-10T14:30:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2351 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[6216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[6216](info): set up 2 sockets
Aug 10 14:30:44 dist-test-slave-0b58 krb5kdc[6216](info): commencing operation
krb5kdc: starting...
W20260810 14:30:45.598326 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:45 dist-test-slave-0b58 krb5kdc[6216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:45.728233 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44549
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:44549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:45.841809 6230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:45.842144 6230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:45.842227 6230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:45.846356 6230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:45.846457 6230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:45.846499 6230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:45.846560 6230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:45.846599 6230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:45.852073 6230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:44549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:45.853209 6230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:45.854300 6230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:45.862818 6236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:45.862807 6237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:45.862843 6239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:45.862962 6230 server_base.cc:1034] running on GCE node
I20260810 14:30:45.863801 6230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:45.865100 6230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:45.866266 6230 hybrid_clock.cc:648] HybridClock initialized: now 1786372245866253 us; error 26 us; skew 500 ppm
Aug 10 14:30:45 dist-test-slave-0b58 krb5kdc[6216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372245, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:45.869055 6230 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:45.869812 6230 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:45.869915 6230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:45.870159 6230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:45.872378 6230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "d5003c1beb9c4be28123483e4d37c5ca"
format_stamp: "Formatted at 2026-08-10 14:30:45 on dist-test-slave-0b58"
server_key: "5b7b1f343d8aff05c891be5a5a46130f"
server_key_iv: "4ae4befe55143aafaa5f5bcb5599a4d7"
server_key_version: "encryptionkey@0"
I20260810 14:30:45.872984 6230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "d5003c1beb9c4be28123483e4d37c5ca"
format_stamp: "Formatted at 2026-08-10 14:30:45 on dist-test-slave-0b58"
server_key: "5b7b1f343d8aff05c891be5a5a46130f"
server_key_iv: "4ae4befe55143aafaa5f5bcb5599a4d7"
server_key_version: "encryptionkey@0"
I20260810 14:30:45.876875 6230 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:30:45.879297 6246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:45.880728 6230 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:45.880867 6230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "d5003c1beb9c4be28123483e4d37c5ca"
format_stamp: "Formatted at 2026-08-10 14:30:45 on dist-test-slave-0b58"
server_key: "5b7b1f343d8aff05c891be5a5a46130f"
server_key_iv: "4ae4befe55143aafaa5f5bcb5599a4d7"
server_key_version: "encryptionkey@0"
I20260810 14:30:45.880995 6230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:45.904887 6230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:45.908183 6230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:45.908452 6230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:45.915872 6230 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:44549
I20260810 14:30:45.916188 6300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:44549 every 8 connection(s)
I20260810 14:30:45.916638 6230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:45.919471 6301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:45.925102 6301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca: Bootstrap starting.
I20260810 14:30:45.925799 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 6230
I20260810 14:30:45.925953 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:45.926225 1849 external_mini_cluster.cc:1428] Setting key 7151351e17a0d52fe2bb9470706c3925
I20260810 14:30:45.927958 6301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:45.928900 6301 log.cc:824] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:45.931550 6301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca: No bootstrap required, opened a new log
Aug 10 14:30:45 dist-test-slave-0b58 krb5kdc[6216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372245, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:45.936331 6301 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5003c1beb9c4be28123483e4d37c5ca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44549 } }
I20260810 14:30:45.936601 6301 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:45.936683 6301 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5003c1beb9c4be28123483e4d37c5ca, State: Initialized, Role: FOLLOWER
I20260810 14:30:45.937245 6301 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5003c1beb9c4be28123483e4d37c5ca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44549 } }
I20260810 14:30:45.937424 6301 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:45.937515 6301 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:45.937628 6301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:45.938604 6301 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5003c1beb9c4be28123483e4d37c5ca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44549 } }
I20260810 14:30:45.938966 6301 leader_election.cc:302] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5003c1beb9c4be28123483e4d37c5ca; no voters:
I20260810 14:30:45.939373 6301 leader_election.cc:288] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:45.939438 6306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:45.939651 6306 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [term 1 LEADER]: Becoming Leader. State: Replica: d5003c1beb9c4be28123483e4d37c5ca, State: Running, Role: LEADER
I20260810 14:30:45.939999 6306 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5003c1beb9c4be28123483e4d37c5ca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44549 } }
I20260810 14:30:45.940795 6301 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:45.941754 6308 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5003c1beb9c4be28123483e4d37c5ca. Latest consensus state: current_term: 1 leader_uuid: "d5003c1beb9c4be28123483e4d37c5ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5003c1beb9c4be28123483e4d37c5ca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44549 } } }
I20260810 14:30:45.941905 6308 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:45.942350 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:45.927490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53596 (local address 127.1.206.126:44549)
0810 14:30:45.928005 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:45.928028 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:45.928072 (+ 44us) server_negotiation.cc:407] Connection header received
0810 14:30:45.928985 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:45.929011 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:45.929440 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:45.929798 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:45.930643 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:45.931697 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:45.932880 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:45.933385 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:45.933509 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:45.936480 (+ 2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:45.936485 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:45.936500 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:45.936529 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:45.938437 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:45.938957 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:45.938963 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:45.938969 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:45.939112 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:45.939446 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:45.939449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:45.939452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:45.940005 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:45.940865 (+ 860us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:45.941015 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 14:30:45.941343 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":136,"threads_started":1}
I20260810 14:30:45.942337 6307 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5003c1beb9c4be28123483e4d37c5ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5003c1beb9c4be28123483e4d37c5ca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44549 } } }
I20260810 14:30:45.942665 6307 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:45.943006 6316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:45.945781 6316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:45.951784 6316 catalog_manager.cc:1347] Generated new cluster ID: 0334bdae9dd74eb4881f1c93262aeca2
I20260810 14:30:45.951866 6316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:45.972365 6316 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:45.973395 6316 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:45.985819 6316 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca: Generated new TSK 0
I20260810 14:30:45.986706 6316 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:46.019024 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44549
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:46.132903 6329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:46.133180 6329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:46.133229 6329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:46.137326 6329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:46.137388 6329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:46.137449 6329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:46.143133 6329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:46.144178 6329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:46.145174 6329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:46.155050 6338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:46.155057 6335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:46.155220 6329 server_base.cc:1034] running on GCE node
W20260810 14:30:46.155048 6336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:46.155968 6329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:46.156720 6329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:46.157920 6329 hybrid_clock.cc:648] HybridClock initialized: now 1786372246157892 us; error 41 us; skew 500 ppm
Aug 10 14:30:46 dist-test-slave-0b58 krb5kdc[6216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372246, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:46.160902 6329 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:46.161616 6329 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:46.161682 6329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:46.161847 6329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:46.163946 6329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "b056923e74c3292704ea88ec3607237b"
server_key_iv: "2e21d2acf4cacdf14616a6bd9d0bdf0e"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.164554 6329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "b056923e74c3292704ea88ec3607237b"
server_key_iv: "2e21d2acf4cacdf14616a6bd9d0bdf0e"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.168526 6329 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 14:30:46.171010 6344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.172392 6329 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:46.172529 6329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "b056923e74c3292704ea88ec3607237b"
server_key_iv: "2e21d2acf4cacdf14616a6bd9d0bdf0e"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.172653 6329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:46.190083 6329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:46.193590 6329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:46.193810 6329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:46.194410 6329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:46.195264 6329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:46.195345 6329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.195415 6329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:46.195446 6329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.204519 6329 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:34319
I20260810 14:30:46.204540 6465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:34319 every 8 connection(s)
I20260810 14:30:46.205150 6329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:46.206193 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 6329
I20260810 14:30:46.206290 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:46.206614 1849 external_mini_cluster.cc:1428] Setting key 9a7cb8145ee9030d2ec0a2c61c2d0951
Aug 10 14:30:46 dist-test-slave-0b58 krb5kdc[6216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372246, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:30:46.219763 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.207062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:35413 (local address 127.1.206.126:44549)
0810 14:30:46.207235 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.207240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.208357 (+ 1117us) server_negotiation.cc:407] Connection header received
0810 14:30:46.209709 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.209712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.209766 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.209853 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:46.211023 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.211562 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.212821 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.213060 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.213178 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.215842 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:46.215850 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:46.215852 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:46.215877 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:46.217558 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.218057 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.218060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.218061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.218139 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.218485 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.218488 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.218490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.218744 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:46.218828 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.219417 (+ 589us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.219571 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 14:30:46.220603 6468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.207578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:44549 (local address 127.1.206.65:35413)
0810 14:30:46.208155 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.208219 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.209506 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.210036 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.210043 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.210398 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:46.210873 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.210886 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.211698 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.211707 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.212674 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.212685 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.213215 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.213220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.213392 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.213999 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:46.214016 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:46.215665 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:46.217673 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:46.217678 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:46.217689 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:46.217966 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:46.218220 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:46.218222 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:46.218223 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:46.218353 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:46.218851 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:46.218856 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:46.219140 (+ 284us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.219358 (+ 218us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.219668 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":150,"threads_started":1}
I20260810 14:30:46.222035 6466 heartbeater.cc:347] Connected to a master server at 127.1.206.126:44549
I20260810 14:30:46.222282 6466 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:46.222868 6466 heartbeater.cc:511] Master 127.1.206.126:44549 requested a full tablet report, sending...
I20260810 14:30:46.224916 6263 ts_manager.cc:194] Registered new tserver with Master: 1c2f3ec589694ee9bd9b9c78b4fc5c53 (127.1.206.65:34319)
I20260810 14:30:46.226599 6263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:35413
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:46.239220 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44549
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:46.355145 6471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:46.355400 6471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:46.355446 6471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:46.359524 6471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:46.359593 6471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:46.359654 6471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:46.365023 6471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:46.366132 6471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:46.367120 6471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:46.376570 6476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:46.376878 6479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:46.377159 6477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:46.377192 6471 server_base.cc:1034] running on GCE node
I20260810 14:30:46.377664 6471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:46.378350 6471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:46.379536 6471 hybrid_clock.cc:648] HybridClock initialized: now 1786372246379511 us; error 34 us; skew 500 ppm
Aug 10 14:30:46 dist-test-slave-0b58 krb5kdc[6216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372246, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:46.382589 6471 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:46.383370 6471 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:46.383471 6471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:46.383742 6471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:46.386067 6471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "23f447ebcd06493daa911ee13c005fc7"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "9793998d6573bf28f6458d7c7fd4b62a"
server_key_iv: "72417f502552a94bd724250352222b5a"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.386686 6471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "23f447ebcd06493daa911ee13c005fc7"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "9793998d6573bf28f6458d7c7fd4b62a"
server_key_iv: "72417f502552a94bd724250352222b5a"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.390345 6471 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 14:30:46.392755 6487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.393936 6471 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:46.394085 6471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "23f447ebcd06493daa911ee13c005fc7"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "9793998d6573bf28f6458d7c7fd4b62a"
server_key_iv: "72417f502552a94bd724250352222b5a"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.394199 6471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:46.422550 6471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:46.426011 6471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:46.426283 6471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:46.426945 6471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:46.427919 6471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:46.428004 6471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.428086 6471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:46.428135 6471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.437638 6471 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:36281
I20260810 14:30:46.437651 6606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:36281 every 8 connection(s)
I20260810 14:30:46.438490 6471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:46.447389 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 6471
I20260810 14:30:46.447518 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:46.447855 1849 external_mini_cluster.cc:1428] Setting key bdb9b3a74f599502dc6fa75655fe9c00
Aug 10 14:30:46 dist-test-slave-0b58 krb5kdc[6216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372246, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:46.454442 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.440739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:58859 (local address 127.1.206.126:44549)
0810 14:30:46.440925 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.440930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.442190 (+ 1260us) server_negotiation.cc:407] Connection header received
0810 14:30:46.443603 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.443606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.443666 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.443756 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:46.444979 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.445567 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.446740 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.446982 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.447072 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.450303 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:46.450307 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:46.450309 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:46.450336 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:46.451981 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.452668 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.452674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.452682 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.452768 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.453199 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.453202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.453204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.453398 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:46.453521 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.454091 (+ 570us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.454247 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 14:30:46.455358 6609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.441259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:44549 (local address 127.1.206.66:58859)
0810 14:30:46.442012 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.442067 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.443379 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.443891 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.443897 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.444307 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:46.444820 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.444835 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.445688 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.445690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.446595 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.446604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.447152 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.447157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.447388 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.448144 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:46.448167 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:46.450106 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:46.452130 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:46.452137 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:46.452155 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:46.452538 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:46.452884 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:46.452888 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:46.452890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:46.453066 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:46.453520 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:46.453528 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:46.453815 (+ 287us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.454019 (+ 204us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.454396 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":171,"threads_started":1}
I20260810 14:30:46.456720 6607 heartbeater.cc:347] Connected to a master server at 127.1.206.126:44549
I20260810 14:30:46.456997 6607 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:46.457471 6607 heartbeater.cc:511] Master 127.1.206.126:44549 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:46.458664 6263 ts_manager.cc:194] Registered new tserver with Master: 23f447ebcd06493daa911ee13c005fc7 (127.1.206.66:36281)
I20260810 14:30:46.459379 6263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:58859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:46.480037 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44549
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:46.593796 6612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:46.594072 6612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:46.594118 6612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:46.598270 6612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:46.598336 6612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:46.598395 6612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:46.603860 6612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:44549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:46.604949 6612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:46.605938 6612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:46.615211 6618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:46.615206 6621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:46.615208 6617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:46.615414 6612 server_base.cc:1034] running on GCE node
I20260810 14:30:46.615958 6612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:46.616678 6612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:46.617865 6612 hybrid_clock.cc:648] HybridClock initialized: now 1786372246617851 us; error 27 us; skew 500 ppm
Aug 10 14:30:46 dist-test-slave-0b58 krb5kdc[6216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372246, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:46.620738 6612 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:46.621484 6612 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:46.621582 6612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:46.621819 6612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:46.623864 6612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "b3f1939788de497480ae282fd432b09d"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "29b9b9716592803484e7a4fdd561da14"
server_key_iv: "e6f99b55608b15c5bdb5c76f8be7ce58"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.624506 6612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "b3f1939788de497480ae282fd432b09d"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "29b9b9716592803484e7a4fdd561da14"
server_key_iv: "e6f99b55608b15c5bdb5c76f8be7ce58"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.628201 6612 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:46.630788 6629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.632010 6612 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:46.632151 6612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "b3f1939788de497480ae282fd432b09d"
format_stamp: "Formatted at 2026-08-10 14:30:46 on dist-test-slave-0b58"
server_key: "29b9b9716592803484e7a4fdd561da14"
server_key_iv: "e6f99b55608b15c5bdb5c76f8be7ce58"
server_key_version: "encryptionkey@0"
I20260810 14:30:46.632347 6612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:46.662648 6612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:46.665970 6612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:46.666206 6612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:46.666855 6612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:46.667727 6612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:46.667800 6612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.667870 6612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:46.667914 6612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:46.677330 6612 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:38775
I20260810 14:30:46.677357 6747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:38775 every 8 connection(s)
I20260810 14:30:46.677966 6612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:30:46 dist-test-slave-0b58 krb5kdc[6216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372246, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:46.688120 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 6612
I20260810 14:30:46.688287 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:46.688666 1849 external_mini_cluster.cc:1428] Setting key 0393935b4fb8aa1eaecd8ed7ff4bf03e
I20260810 14:30:46.692636 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.679827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:45349 (local address 127.1.206.126:44549)
0810 14:30:46.679987 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.679992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.680975 (+ 983us) server_negotiation.cc:407] Connection header received
0810 14:30:46.682429 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.682432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.682484 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.682563 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:46.683757 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.684389 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.685628 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.685863 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.685943 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.688581 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:46.688584 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:46.688586 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:46.688612 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:46.690365 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.691009 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.691014 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.691016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.691108 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.691480 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.691484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.691486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.691685 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:46.691797 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.692345 (+ 548us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.692475 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:30:46.693463 6750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.680345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:44549 (local address 127.1.206.67:45349)
0810 14:30:46.680816 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.680861 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.682206 (+ 1345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.682732 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.682739 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.683119 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:46.683621 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.683635 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.684502 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.684505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.685521 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.685531 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.685992 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.685995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.686157 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.686739 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:46.686756 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:46.688400 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:46.690480 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:46.690486 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:46.690502 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:46.690900 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:46.691206 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:46.691210 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:46.691212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:46.691370 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:46.691797 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:46.691805 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:46.692072 (+ 267us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.692295 (+ 223us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.692640 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":119,"threads_started":1}
I20260810 14:30:46.694527 6748 heartbeater.cc:347] Connected to a master server at 127.1.206.126:44549
I20260810 14:30:46.694790 6748 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:46.695245 6748 heartbeater.cc:511] Master 127.1.206.126:44549 requested a full tablet report, sending...
I20260810 14:30:46.696300 6263 ts_manager.cc:194] Registered new tserver with Master: b3f1939788de497480ae282fd432b09d (127.1.206.67:38775)
I20260810 14:30:46.696897 6263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:45349
I20260810 14:30:46.702890 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:30:46.713562 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.705396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53610 (local address 127.1.206.126:44549)
0810 14:30:46.705663 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.705668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.705831 (+ 163us) server_negotiation.cc:407] Connection header received
0810 14:30:46.706009 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.706012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.706064 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.706183 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:46.706981 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.707526 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.708609 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.708841 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.708924 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.710454 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:46.710457 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:46.710459 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:46.710484 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:46.711831 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.712370 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.712373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.712374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.712454 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:46.712699 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:46.712701 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:46.712702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:46.712928 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:46.713031 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.713311 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.713420 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260810 14:30:46.716689 6263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53610:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:46.719758 6263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:46.735013 6762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.729629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:36281 (local address 127.0.0.1:52682)
0810 14:30:46.730190 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.730204 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.730306 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.730892 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.730898 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.730921 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:46.731100 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.731108 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.732168 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.732171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.733469 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.733479 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.734443 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.734446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.734555 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.734601 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.734717 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.734848 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"mutex_wait_us":5,"thread_start_us":112,"threads_started":1}
I20260810 14:30:46.735050 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.730067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52682 (local address 127.1.206.66:36281)
0810 14:30:46.730467 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.730477 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.730497 (+ 20us) server_negotiation.cc:407] Connection header received
0810 14:30:46.730558 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.730562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.730699 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.730896 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:46.731246 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.732022 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.733593 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.734320 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.734433 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.734584 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.734767 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.734884 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":100,"threads_started":1}
I20260810 14:30:46.735383 6759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.728934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38775 (local address 127.0.0.1:59882)
0810 14:30:46.729473 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.729527 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.729662 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.730991 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.730994 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.731017 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:46.731164 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.731172 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.732617 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.732620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.733868 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.733879 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.734969 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.734973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.735070 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.735102 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.735158 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.735238 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":46,"thread_start_us":105,"threads_started":1}
I20260810 14:30:46.735929 6760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.729143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34319 (local address 127.0.0.1:52378)
0810 14:30:46.730123 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.730137 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.730240 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.731056 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.731059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.731072 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:46.731177 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.731184 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.732616 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.732620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.734195 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.734203 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.735475 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.735478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.735565 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.735595 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.735670 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.735745 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":906,"mutex_wait_us":3,"thread_start_us":112,"threads_started":1}
I20260810 14:30:46.736315 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.729088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59882 (local address 127.1.206.67:38775)
0810 14:30:46.730552 (+ 1464us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.730564 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.730584 (+ 20us) server_negotiation.cc:407] Connection header received
0810 14:30:46.730647 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.730651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.730834 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.731091 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:46.731243 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.732454 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.734012 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.734825 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.735796 (+ 971us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.735989 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.736040 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.736139 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1363,"thread_start_us":182,"threads_started":1}
I20260810 14:30:46.736900 6763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.729773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52378 (local address 127.1.206.65:34319)
0810 14:30:46.730052 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.730059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.730364 (+ 305us) server_negotiation.cc:407] Connection header received
0810 14:30:46.730462 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.730468 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.730691 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.730873 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:46.731332 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.732500 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.734320 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.735120 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.735239 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.735393 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.736594 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.736755 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":76,"threads_started":1}
I20260810 14:30:46.738531 6536 tablet_service.cc:1467] Processing CreateTablet for tablet f1676a76adc745629edb76c9f9078e05 (DEFAULT_TABLE table=test-table [id=97657108684440a78e9581126b9427fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:46.738953 6679 tablet_service.cc:1467] Processing CreateTablet for tablet f1676a76adc745629edb76c9f9078e05 (DEFAULT_TABLE table=test-table [id=97657108684440a78e9581126b9427fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:46.739588 6536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1676a76adc745629edb76c9f9078e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:46.739468 6394 tablet_service.cc:1467] Processing CreateTablet for tablet f1676a76adc745629edb76c9f9078e05 (DEFAULT_TABLE table=test-table [id=97657108684440a78e9581126b9427fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:46.740002 6679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1676a76adc745629edb76c9f9078e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:46.740480 6394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1676a76adc745629edb76c9f9078e05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:46.746654 6765 tablet_bootstrap.cc:492] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Bootstrap starting.
I20260810 14:30:46.748037 6766 tablet_bootstrap.cc:492] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Bootstrap starting.
I20260810 14:30:46.748589 6767 tablet_bootstrap.cc:492] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: Bootstrap starting.
I20260810 14:30:46.749397 6765 tablet_bootstrap.cc:654] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:46.750165 6765 log.cc:824] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:46.750350 6766 tablet_bootstrap.cc:654] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:46.750674 6767 tablet_bootstrap.cc:654] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:46.751605 6767 log.cc:824] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:46.751605 6766 log.cc:824] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:46.752705 6765 tablet_bootstrap.cc:492] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: No bootstrap required, opened a new log
I20260810 14:30:46.752928 6765 ts_tablet_manager.cc:1397] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:30:46.753635 6767 tablet_bootstrap.cc:492] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: No bootstrap required, opened a new log
I20260810 14:30:46.753890 6767 ts_tablet_manager.cc:1397] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 14:30:46.753899 6766 tablet_bootstrap.cc:492] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: No bootstrap required, opened a new log
I20260810 14:30:46.754086 6766 ts_tablet_manager.cc:1397] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:30:46.757100 6765 raft_consensus.cc:348] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.757434 6765 raft_consensus.cc:374] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:46.757300 6767 raft_consensus.cc:348] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.757500 6765 raft_consensus.cc:729] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23f447ebcd06493daa911ee13c005fc7, State: Initialized, Role: FOLLOWER
I20260810 14:30:46.757550 6767 raft_consensus.cc:374] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:46.757611 6767 raft_consensus.cc:729] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c2f3ec589694ee9bd9b9c78b4fc5c53, State: Initialized, Role: FOLLOWER
I20260810 14:30:46.757965 6765 consensus_queue.cc:260] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.758080 6767 consensus_queue.cc:260] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.758500 6766 raft_consensus.cc:348] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.758754 6766 raft_consensus.cc:374] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:46.758831 6766 raft_consensus.cc:729] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3f1939788de497480ae282fd432b09d, State: Initialized, Role: FOLLOWER
I20260810 14:30:46.759073 6765 ts_tablet_manager.cc:1428] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:30:46.759074 6767 ts_tablet_manager.cc:1428] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 14:30:46.759236 6766 consensus_queue.cc:260] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.759438 6466 heartbeater.cc:503] Master 127.1.206.126:44549 was elected leader, sending a full tablet report...
I20260810 14:30:46.759438 6607 heartbeater.cc:503] Master 127.1.206.126:44549 was elected leader, sending a full tablet report...
I20260810 14:30:46.760151 6766 ts_tablet_manager.cc:1428] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:30:46.760504 6748 heartbeater.cc:503] Master 127.1.206.126:44549 was elected leader, sending a full tablet report...
I20260810 14:30:46.919356 6773 raft_consensus.cc:482] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:46.919600 6773 raft_consensus.cc:504] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.920907 6773 leader_election.cc:288] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c2f3ec589694ee9bd9b9c78b4fc5c53 (127.1.206.65:34319), 23f447ebcd06493daa911ee13c005fc7 (127.1.206.66:36281)
I20260810 14:30:46.925575 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.921179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34319 (local address 127.1.206.67:40375)
0810 14:30:46.921776 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.921788 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.921910 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.922197 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.922200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.922218 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:46.922332 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.922338 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.923332 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.923334 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.924228 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.924240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.925107 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.925111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.925220 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.925248 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.925336 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.925408 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":200,"thread_start_us":124,"threads_started":1}
I20260810 14:30:46.925602 6763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.921419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:40375 (local address 127.1.206.65:34319)
0810 14:30:46.921561 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.921566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.921881 (+ 315us) server_negotiation.cc:407] Connection header received
0810 14:30:46.922027 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.922030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.922080 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.922170 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:46.922456 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.923188 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.924385 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.924948 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.925071 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.925137 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.925379 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.925469 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:30:46.925942 6750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.921168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:36281 (local address 127.1.206.67:55525)
0810 14:30:46.921334 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:46.921352 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:46.921449 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:46.922031 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:46.922034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:46.922049 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:46.922189 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.922196 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.923240 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.923244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.924556 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:46.924567 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.925519 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.925523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:46.925649 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.925674 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 14:30:46.925749 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 14:30:46.925829 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76,"mutex_wait_us":3}
I20260810 14:30:46.926275 6414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1676a76adc745629edb76c9f9078e05" candidate_uuid: "b3f1939788de497480ae282fd432b09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" is_pre_election: true
I20260810 14:30:46.926494 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.921655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:55525 (local address 127.1.206.66:36281)
0810 14:30:46.921812 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.921817 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.921832 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:30:46.921886 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.921889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.921937 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.922012 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:46.922315 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.923118 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.924694 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.925276 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.925415 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.925459 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.926232 (+ 773us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.926315 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 14:30:46.926652 6414 raft_consensus.cc:2454] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3f1939788de497480ae282fd432b09d in term 0.
I20260810 14:30:46.927125 6556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1676a76adc745629edb76c9f9078e05" candidate_uuid: "b3f1939788de497480ae282fd432b09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23f447ebcd06493daa911ee13c005fc7" is_pre_election: true
I20260810 14:30:46.927207 6632 leader_election.cc:302] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c2f3ec589694ee9bd9b9c78b4fc5c53, b3f1939788de497480ae282fd432b09d; no voters:
I20260810 14:30:46.927477 6556 raft_consensus.cc:2454] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3f1939788de497480ae282fd432b09d in term 0.
I20260810 14:30:46.927520 6773 raft_consensus.cc:2781] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:46.927618 6773 raft_consensus.cc:482] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:46.927675 6773 raft_consensus.cc:3037] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 0 FOLLOWER]: Advancing to term 1
W20260810 14:30:46.928866 6749 tablet.cc:2369] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:46.928983 6773 raft_consensus.cc:504] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.929416 6773 leader_election.cc:288] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [CANDIDATE]: Term 1 election: Requested vote from peers 1c2f3ec589694ee9bd9b9c78b4fc5c53 (127.1.206.65:34319), 23f447ebcd06493daa911ee13c005fc7 (127.1.206.66:36281)
I20260810 14:30:46.929798 6414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1676a76adc745629edb76c9f9078e05" candidate_uuid: "b3f1939788de497480ae282fd432b09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53"
I20260810 14:30:46.929859 6556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1676a76adc745629edb76c9f9078e05" candidate_uuid: "b3f1939788de497480ae282fd432b09d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23f447ebcd06493daa911ee13c005fc7"
I20260810 14:30:46.929975 6556 raft_consensus.cc:3037] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:46.929951 6414 raft_consensus.cc:3037] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:46.931319 6556 raft_consensus.cc:2454] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3f1939788de497480ae282fd432b09d in term 1.
I20260810 14:30:46.931319 6414 raft_consensus.cc:2454] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3f1939788de497480ae282fd432b09d in term 1.
I20260810 14:30:46.931680 6631 leader_election.cc:302] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1c2f3ec589694ee9bd9b9c78b4fc5c53, 23f447ebcd06493daa911ee13c005fc7, b3f1939788de497480ae282fd432b09d; no voters:
I20260810 14:30:46.931844 6773 raft_consensus.cc:2781] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:46.932058 6773 raft_consensus.cc:686] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 1 LEADER]: Becoming Leader. State: Replica: b3f1939788de497480ae282fd432b09d, State: Running, Role: LEADER
I20260810 14:30:46.932442 6773 consensus_queue.cc:237] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } }
I20260810 14:30:46.935899 6263 catalog_manager.cc:5495] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d reported cstate change: term changed from 0 to 1, leader changed from <none> to b3f1939788de497480ae282fd432b09d (127.1.206.67). New cstate: current_term: 1 leader_uuid: "b3f1939788de497480ae282fd432b09d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3f1939788de497480ae282fd432b09d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 } health_report { overall_health: UNKNOWN } } }
W20260810 14:30:46.940071 6608 tablet.cc:2369] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:30:46.956521 6467 tablet.cc:2369] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:46.972756 6761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:46.968973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59892 (local address 127.1.206.67:38775)
0810 14:30:46.969136 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:46.969143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:46.969159 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:30:46.969251 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:46.969253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:46.969307 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:46.969432 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:46.969725 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.970235 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.971135 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:46.971365 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:46.971472 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:46.971808 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:46.972244 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:46.972446 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:46.972483 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 14:30:46.972554 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 14:30:46.979282 6414 raft_consensus.cc:1261] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 1 FOLLOWER]: Refusing update from remote peer b3f1939788de497480ae282fd432b09d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:46.979282 6556 raft_consensus.cc:1261] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 1 FOLLOWER]: Refusing update from remote peer b3f1939788de497480ae282fd432b09d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:46.980229 6773 consensus_queue.cc:1035] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [LEADER]: Connected to new peer: Peer: permanent_uuid: "23f447ebcd06493daa911ee13c005fc7" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:46.980527 6775 consensus_queue.cc:1035] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c2f3ec589694ee9bd9b9c78b4fc5c53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:46.989096 6780 mvcc.cc:205] Tried to move back new op lower bound from 7316980723619278848 to 7316980723438100480. Current Snapshot: MvccSnapshot[applied={T|T < 7316980723619278848}]
I20260810 14:30:46.992738 6779 mvcc.cc:205] Tried to move back new op lower bound from 7316980723619278848 to 7316980723438100480. Current Snapshot: MvccSnapshot[applied={T|T < 7316980723619278848 or (T in {7316980723619278848})}]
I20260810 14:30:46.996901 6263 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:46.997087 6263 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:46.999728 6263 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5003c1beb9c4be28123483e4d37c5ca: Sending DeleteTablet for 3 replicas of tablet f1676a76adc745629edb76c9f9078e05
I20260810 14:30:47.000605 6536 tablet_service.cc:1514] Processing DeleteTablet for tablet f1676a76adc745629edb76c9f9078e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:46 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:52682
I20260810 14:30:47.000630 6679 tablet_service.cc:1514] Processing DeleteTablet for tablet f1676a76adc745629edb76c9f9078e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:46 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:59882
I20260810 14:30:47.000628 6394 tablet_service.cc:1514] Processing DeleteTablet for tablet f1676a76adc745629edb76c9f9078e05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:46 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:52378
I20260810 14:30:47.001156 6787 tablet_replica.cc:330] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53: stopping tablet replica
I20260810 14:30:47.001382 6789 tablet_replica.cc:330] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: stopping tablet replica
I20260810 14:30:47.001520 6787 raft_consensus.cc:2229] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:47.001767 6789 raft_consensus.cc:2229] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:47.001911 6787 raft_consensus.cc:2258] T f1676a76adc745629edb76c9f9078e05 P 1c2f3ec589694ee9bd9b9c78b4fc5c53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:47.002036 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 6329
I20260810 14:30:47.004834 6789 raft_consensus.cc:2258] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:47.006376 6789 ts_tablet_manager.cc:1905] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:47.008509 6788 tablet_replica.cc:330] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: stopping tablet replica
I20260810 14:30:47.008908 6789 ts_tablet_manager.cc:1918] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:47.009027 6789 log.cc:1196] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/f1676a76adc745629edb76c9f9078e05
I20260810 14:30:47.008925 6788 raft_consensus.cc:2229] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:47.009382 6789 ts_tablet_manager.cc:1939] T f1676a76adc745629edb76c9f9078e05 P 23f447ebcd06493daa911ee13c005fc7: Deleting consensus metadata
I20260810 14:30:47.009640 6788 raft_consensus.cc:2258] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:47.011099 6788 ts_tablet_manager.cc:1905] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:47.011242 6248 catalog_manager.cc:4841] TS 23f447ebcd06493daa911ee13c005fc7 (127.1.206.66:36281): tablet f1676a76adc745629edb76c9f9078e05 (table test-table [id=97657108684440a78e9581126b9427fd]) successfully deleted
W20260810 14:30:47.011353 6249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:34319 (error 108)
I20260810 14:30:47.011602 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 6471
I20260810 14:30:47.015523 6788 ts_tablet_manager.cc:1918] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:47.015650 6788 log.cc:1196] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/f1676a76adc745629edb76c9f9078e05
I20260810 14:30:47.015955 6788 ts_tablet_manager.cc:1939] T f1676a76adc745629edb76c9f9078e05 P b3f1939788de497480ae282fd432b09d: Deleting consensus metadata
I20260810 14:30:47.017120 6760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.014865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34319 (local address 127.0.0.1:52380)
0810 14:30:47.016920 (+ 2055us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:47.017006 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:34319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1943}
I20260810 14:30:47.017465 6250 catalog_manager.cc:4841] TS b3f1939788de497480ae282fd432b09d (127.1.206.67:38775): tablet f1676a76adc745629edb76c9f9078e05 (table test-table [id=97657108684440a78e9581126b9427fd]) successfully deleted
W20260810 14:30:47.017869 6249 catalog_manager.cc:4584] TS 1c2f3ec589694ee9bd9b9c78b4fc5c53 (127.1.206.65:34319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f1676a76adc745629edb76c9f9078e05: Network error: Client connection negotiation failed: client connection to 127.1.206.65:34319: connect: Connection refused (error 111)
I20260810 14:30:47.023016 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 6612
I20260810 14:30:47.031293 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 6230
2026-08-10T14:30:47Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2515 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T14:30:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:47Z Disabled control of system clock
I20260810 14:30:47.065506 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45625
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:45625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 14:30:47.179335 6794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:47.179623 6794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:47.179665 6794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:47.183843 6794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:47.183912 6794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:47.183928 6794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:47.183946 6794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:47.183961 6794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:47.189517 6794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:45625
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:47.190582 6794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:47.191901 6794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:47.200801 6801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:47.200809 6804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:47.200836 6800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:47.200985 6794 server_base.cc:1034] running on GCE node
I20260810 14:30:47.201754 6794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:47.202945 6794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:47.204157 6794 hybrid_clock.cc:648] HybridClock initialized: now 1786372247204143 us; error 29 us; skew 500 ppm
I20260810 14:30:47.210697 6794 webserver.cc:460] Webserver started at http://127.1.206.126:36065/ using document root <none> and password file <none>
I20260810 14:30:47.211438 6794 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:47.211544 6794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:47.211795 6794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:47.214087 6794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "3740b2027f58497b9157d3a63d72700b"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "090ce8c75689939fc61b8e3a5623a991"
server_key_iv: "7cfef3006d1730689bb1b1ffe573e7e4"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.214686 6794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "3740b2027f58497b9157d3a63d72700b"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "090ce8c75689939fc61b8e3a5623a991"
server_key_iv: "7cfef3006d1730689bb1b1ffe573e7e4"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.218519 6794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 14:30:47.221153 6810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.222668 6794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:47.222827 6794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "3740b2027f58497b9157d3a63d72700b"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "090ce8c75689939fc61b8e3a5623a991"
server_key_iv: "7cfef3006d1730689bb1b1ffe573e7e4"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.222959 6794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:47.228184 6794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:47.228888 6794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:47.229099 6794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:47.236831 6794 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:45625
I20260810 14:30:47.236882 6864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:45625 every 8 connection(s)
I20260810 14:30:47.237948 6794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:47.241564 6865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:47.241572 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 6794
I20260810 14:30:47.241698 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:47.241982 1849 external_mini_cluster.cc:1428] Setting key 2326c2ed7ca3b9b5ec31a4107c0983bb
I20260810 14:30:47.248608 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.243501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35934 (local address 127.1.206.126:45625)
0810 14:30:47.244292 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.244314 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.244362 (+ 48us) server_negotiation.cc:407] Connection header received
0810 14:30:47.245171 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.245198 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.245682 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.246100 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.246977 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.246983 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.247000 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.247014 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.247087 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.247111 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.247268 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.247342 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.247623 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":137,"threads_started":1}
I20260810 14:30:47.249493 6865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b: Bootstrap starting.
I20260810 14:30:47.251915 6865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:47.252811 6865 log.cc:824] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:47.254914 6865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b: No bootstrap required, opened a new log
I20260810 14:30:47.258625 6865 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3740b2027f58497b9157d3a63d72700b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45625 } }
I20260810 14:30:47.258867 6865 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:47.258908 6865 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3740b2027f58497b9157d3a63d72700b, State: Initialized, Role: FOLLOWER
I20260810 14:30:47.259286 6865 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3740b2027f58497b9157d3a63d72700b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45625 } }
I20260810 14:30:47.259397 6865 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:47.259446 6865 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:47.259517 6865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:47.260725 6865 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3740b2027f58497b9157d3a63d72700b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45625 } }
I20260810 14:30:47.261080 6865 leader_election.cc:302] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3740b2027f58497b9157d3a63d72700b; no voters:
I20260810 14:30:47.261446 6865 leader_election.cc:288] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:47.261584 6870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:47.261842 6870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [term 1 LEADER]: Becoming Leader. State: Replica: 3740b2027f58497b9157d3a63d72700b, State: Running, Role: LEADER
I20260810 14:30:47.262181 6870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3740b2027f58497b9157d3a63d72700b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45625 } }
I20260810 14:30:47.262796 6865 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:47.263962 6872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3740b2027f58497b9157d3a63d72700b. Latest consensus state: current_term: 1 leader_uuid: "3740b2027f58497b9157d3a63d72700b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3740b2027f58497b9157d3a63d72700b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45625 } } }
I20260810 14:30:47.263919 6871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3740b2027f58497b9157d3a63d72700b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3740b2027f58497b9157d3a63d72700b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45625 } } }
I20260810 14:30:47.264078 6871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:47.264168 6872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:47.264484 6879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:47.267778 6879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:47.274042 6879 catalog_manager.cc:1347] Generated new cluster ID: a73303d9449549a1b7fb25819aea3d61
I20260810 14:30:47.274134 6879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:47.290309 6879 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:47.290755 6879 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:47.302659 6879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b: Generated new TSK 0
I20260810 14:30:47.303591 6879 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:30:47.309348 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45625
--builtin_ntp_servers=127.1.206.84:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 14:30:47.477610 6890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:47.477988 6890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:47.478052 6890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:47.483362 6890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:47.483448 6890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:47.483513 6890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:47.488970 6890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:47.490091 6890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:47.491513 6890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:47.501710 6896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:47.501727 6897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:47.502070 6890 server_base.cc:1034] running on GCE node
W20260810 14:30:47.501719 6899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:47.502629 6890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:47.503425 6890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:47.504725 6890 hybrid_clock.cc:648] HybridClock initialized: now 1786372247504703 us; error 33 us; skew 500 ppm
I20260810 14:30:47.506858 6890 webserver.cc:460] Webserver started at http://127.1.206.65:43747/ using document root <none> and password file <none>
I20260810 14:30:47.507483 6890 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:47.507581 6890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:47.507833 6890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:47.510023 6890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "6aedc21a76e3441db4ce9080249bf916"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "b9c6a1dd3710b5a375f752b0461617e9"
server_key_iv: "f52442fec68eb606fcc0a10570ba1a7f"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.510602 6890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "6aedc21a76e3441db4ce9080249bf916"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "b9c6a1dd3710b5a375f752b0461617e9"
server_key_iv: "f52442fec68eb606fcc0a10570ba1a7f"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.514477 6890 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260810 14:30:47.516969 6906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.518232 6890 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:47.518381 6890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "6aedc21a76e3441db4ce9080249bf916"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "b9c6a1dd3710b5a375f752b0461617e9"
server_key_iv: "f52442fec68eb606fcc0a10570ba1a7f"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.518504 6890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:47.523276 6890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:47.523940 6890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:47.524142 6890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:47.524801 6890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:47.525789 6890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:47.525861 6890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.525964 6890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:47.526021 6890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.535760 6890 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:36925
I20260810 14:30:47.535760 7025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:36925 every 8 connection(s)
I20260810 14:30:47.536888 6890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:47.538733 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 6890
I20260810 14:30:47.538905 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:47.539247 1849 external_mini_cluster.cc:1428] Setting key 93ec8bf71d3a9f895fdd789a6c3c3dc3
I20260810 14:30:47.541633 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45625
--builtin_ntp_servers=127.1.206.84:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 14:30:47.544395 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.539003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:55401 (local address 127.1.206.126:45625)
0810 14:30:47.539172 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.539177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.540549 (+ 1372us) server_negotiation.cc:407] Connection header received
0810 14:30:47.542333 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.542336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.542373 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.542437 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.543820 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.543827 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.543831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.543849 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.543879 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.543893 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.544005 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.544133 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.544185 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 14:30:47.545320 7029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.539523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:45625 (local address 127.1.206.65:55401)
0810 14:30:47.540421 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:47.540467 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:47.542075 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:47.542661 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:47.542673 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:47.542799 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:47.543470 (+ 671us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:47.543478 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:47.543543 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:47.543641 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:47.543992 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:47.544000 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:47.544004 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:30:47.544138 (+ 134us) client_negotiation.cc:240] Negotiation successful
0810 14:30:47.544414 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":173,"threads_started":1}
I20260810 14:30:47.546789 7026 heartbeater.cc:347] Connected to a master server at 127.1.206.126:45625
I20260810 14:30:47.547071 7026 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:47.547631 7026 heartbeater.cc:511] Master 127.1.206.126:45625 requested a full tablet report, sending...
I20260810 14:30:47.549531 6827 ts_manager.cc:194] Registered new tserver with Master: 6aedc21a76e3441db4ce9080249bf916 (127.1.206.65:36925)
W20260810 14:30:47.659255 7030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:47.659555 7030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:47.659597 7030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:47.664027 7030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:47.664105 7030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:47.664232 7030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:47.669333 7030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:47.670531 7030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:47.671970 7030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:47.681862 7037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:47.681888 7039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:47.681888 7036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:47.681950 7030 server_base.cc:1034] running on GCE node
I20260810 14:30:47.682585 7030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:47.683207 7030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:47.684350 7030 hybrid_clock.cc:648] HybridClock initialized: now 1786372247684319 us; error 27 us; skew 500 ppm
I20260810 14:30:47.686728 7030 webserver.cc:460] Webserver started at http://127.1.206.66:42241/ using document root <none> and password file <none>
I20260810 14:30:47.687354 7030 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:47.687424 7030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:47.687711 7030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:47.689968 7030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "a80254164ead4fecb130ab6fe08994e4"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "ebdf42960329bedc962915fa8de7e800"
server_key_iv: "4f134689e193de643fdd451ee16ef634"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.690690 7030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "a80254164ead4fecb130ab6fe08994e4"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "ebdf42960329bedc962915fa8de7e800"
server_key_iv: "4f134689e193de643fdd451ee16ef634"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.695083 7030 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:47.697948 7045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.699283 7030 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:30:47.699450 7030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "a80254164ead4fecb130ab6fe08994e4"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "ebdf42960329bedc962915fa8de7e800"
server_key_iv: "4f134689e193de643fdd451ee16ef634"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.699595 7030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:47.705221 7030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:47.705964 7030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:47.706213 7030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:47.706871 7030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:47.707911 7030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:47.707986 7030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.708072 7030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:47.708108 7030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.718206 7030 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:36621
I20260810 14:30:47.718209 7167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:36621 every 8 connection(s)
I20260810 14:30:47.719194 7030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:47.721400 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7030
I20260810 14:30:47.721551 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:47.721868 1849 external_mini_cluster.cc:1428] Setting key c1f568bc290394f6bc033fd0a7cdc22a
I20260810 14:30:47.724319 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45625
--builtin_ntp_servers=127.1.206.84:37121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 14:30:47.726363 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.721215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:49809 (local address 127.1.206.126:45625)
0810 14:30:47.721395 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.721400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.722743 (+ 1343us) server_negotiation.cc:407] Connection header received
0810 14:30:47.724341 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.724344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.724381 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.724474 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.725777 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.725780 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.725783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.725796 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.725825 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.725833 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.725944 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.726147 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.726197 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 14:30:47.727372 7171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.721750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:45625 (local address 127.1.206.66:49809)
0810 14:30:47.722573 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:47.722635 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:47.724043 (+ 1408us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:47.724740 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:47.724747 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:47.724836 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:47.725467 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:47.725468 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:47.725518 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:47.725594 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:47.725930 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:47.725940 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:47.725946 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:30:47.726188 (+ 242us) client_negotiation.cc:240] Negotiation successful
0810 14:30:47.726448 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":151,"threads_started":1}
I20260810 14:30:47.728752 7168 heartbeater.cc:347] Connected to a master server at 127.1.206.126:45625
I20260810 14:30:47.729038 7168 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:47.729568 7168 heartbeater.cc:511] Master 127.1.206.126:45625 requested a full tablet report, sending...
I20260810 14:30:47.730784 6827 ts_manager.cc:194] Registered new tserver with Master: a80254164ead4fecb130ab6fe08994e4 (127.1.206.66:36621)
W20260810 14:30:47.841653 7172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:47.841938 7172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:47.842008 7172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:47.846074 7172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:47.846156 7172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:47.846215 7172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:47.851156 7172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:47.852353 7172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:47.853783 7172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:47.863794 7177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:47.863840 7178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:47.863860 7181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:47.864022 7172 server_base.cc:1034] running on GCE node
I20260810 14:30:47.864507 7172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:47.865269 7172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:47.866470 7172 hybrid_clock.cc:648] HybridClock initialized: now 1786372247866436 us; error 48 us; skew 500 ppm
I20260810 14:30:47.868418 7172 webserver.cc:460] Webserver started at http://127.1.206.67:42523/ using document root <none> and password file <none>
I20260810 14:30:47.869009 7172 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:47.869073 7172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:47.869318 7172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:47.871428 7172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "960bf7aa9e9b49199ad298a1e4c6c59d"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "e063da4835af25ec73a6cdc1b6eb99cb"
server_key_iv: "6bd4121653f666835a1f2d7b90f31c1e"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.872107 7172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "960bf7aa9e9b49199ad298a1e4c6c59d"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "e063da4835af25ec73a6cdc1b6eb99cb"
server_key_iv: "6bd4121653f666835a1f2d7b90f31c1e"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.875926 7172 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260810 14:30:47.878585 7187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.879840 7172 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:47.879984 7172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "960bf7aa9e9b49199ad298a1e4c6c59d"
format_stamp: "Formatted at 2026-08-10 14:30:47 on dist-test-slave-0b58"
server_key: "e063da4835af25ec73a6cdc1b6eb99cb"
server_key_iv: "6bd4121653f666835a1f2d7b90f31c1e"
server_key_version: "encryptionkey@0"
I20260810 14:30:47.880110 7172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:47.885066 7172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:47.885807 7172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:47.886004 7172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:47.886603 7172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:47.887622 7172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:47.887696 7172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.887769 7172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:47.887825 7172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:47.896788 7172 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:44419
I20260810 14:30:47.896868 7307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:44419 every 8 connection(s)
I20260810 14:30:47.897766 7172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:47.902477 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7172
I20260810 14:30:47.902617 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:47.902936 1849 external_mini_cluster.cc:1428] Setting key ca49f0621f850fc6598ce7eb9cc1b3e1
I20260810 14:30:47.904572 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.899616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:42575 (local address 127.1.206.126:45625)
0810 14:30:47.899789 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.899794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.900920 (+ 1126us) server_negotiation.cc:407] Connection header received
0810 14:30:47.902331 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.902334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.902376 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.902459 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.903991 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.903994 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.903999 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.904016 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.904038 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.904046 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.904147 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.904384 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.904435 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 14:30:47.905501 7310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.900049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:45625 (local address 127.1.206.67:42575)
0810 14:30:47.900764 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:47.900807 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:47.902023 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:47.902692 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:47.902701 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:47.902837 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:47.903631 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:47.903633 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:47.903700 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:47.903795 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:47.904141 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:47.904152 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:47.904161 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 14:30:47.904434 (+ 273us) client_negotiation.cc:240] Negotiation successful
0810 14:30:47.904699 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":171,"threads_started":1}
I20260810 14:30:47.906656 7308 heartbeater.cc:347] Connected to a master server at 127.1.206.126:45625
I20260810 14:30:47.906904 7308 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:47.907330 7308 heartbeater.cc:511] Master 127.1.206.126:45625 requested a full tablet report, sending...
I20260810 14:30:47.908471 6827 ts_manager.cc:194] Registered new tserver with Master: 960bf7aa9e9b49199ad298a1e4c6c59d (127.1.206.67:44419)
I20260810 14:30:47.917460 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:30:47.921721 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.919596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35950 (local address 127.1.206.126:45625)
0810 14:30:47.919792 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.919796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.919949 (+ 153us) server_negotiation.cc:407] Connection header received
0810 14:30:47.920117 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.920120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.920164 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.920456 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.921279 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.921283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.921286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.921298 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.921320 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.921329 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.921433 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.921511 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.921557 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260810 14:30:47.925091 6827 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:47.928480 6827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:47.940403 7320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.937208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:44419 (local address 127.0.0.1:35888)
0810 14:30:47.938075 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:47.938129 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:47.938249 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:47.938737 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:47.938743 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:47.938822 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:47.939431 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:47.939433 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:47.939454 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:47.939526 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:47.939928 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:47.939939 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:47.939945 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:30:47.940076 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 14:30:47.940164 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":66,"threads_started":1}
I20260810 14:30:47.940418 7321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.937312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35888 (local address 127.1.206.67:44419)
0810 14:30:47.937711 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.937727 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.938241 (+ 514us) server_negotiation.cc:407] Connection header received
0810 14:30:47.938352 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.938358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.938566 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.938724 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.939674 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.939681 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.939693 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.939706 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.939759 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.939797 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.939909 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.940118 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.940213 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":161,"threads_started":1}
I20260810 14:30:47.941511 7322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.937920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:36925 (local address 127.0.0.1:40370)
0810 14:30:47.938768 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:47.938782 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:47.938853 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:47.939997 (+ 1144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:47.939999 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:47.940012 (+ 13us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:47.940641 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:47.940643 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:47.940662 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:47.940689 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:47.941254 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:47.941260 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:47.941263 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:30:47.941321 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 14:30:47.941357 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":785,"thread_start_us":97,"threads_started":1}
I20260810 14:30:47.941514 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.937270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:36621 (local address 127.0.0.1:41992)
0810 14:30:47.938440 (+ 1170us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:47.938456 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:47.938518 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:47.939484 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:47.939488 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:47.939503 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:47.940854 (+ 1351us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:47.940856 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:47.940867 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:47.940894 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:47.941256 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:47.941259 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:47.941263 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:30:47.941329 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 14:30:47.941365 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1108,"thread_start_us":122,"threads_started":1}
I20260810 14:30:47.942094 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.938350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40370 (local address 127.1.206.65:36925)
0810 14:30:47.938827 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.938844 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.938870 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:30:47.938941 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.938948 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.939483 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.939627 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.941049 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.941054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.941064 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.941073 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.941113 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.941141 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.941863 (+ 722us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.941904 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.941963 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":133,"threads_started":1}
I20260810 14:30:47.942164 7323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:47.937889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41992 (local address 127.1.206.66:36621)
0810 14:30:47.939103 (+ 1214us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:47.939116 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:47.939143 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:30:47.939197 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:47.939203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:47.939361 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:47.939495 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:47.941040 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:47.941046 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:47.941057 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:47.941070 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:47.941115 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:47.941151 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:47.941861 (+ 710us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:47.941920 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 14:30:47.941989 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1091,"thread_start_us":153,"threads_started":1}
I20260810 14:30:47.943636 7237 tablet_service.cc:1467] Processing CreateTablet for tablet df7e46934567465fa5d838a4aa8ac080 (DEFAULT_TABLE table=test-table [id=a9f0ad4c0f4b4e40850eb2826d260ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:47.944854 7237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7e46934567465fa5d838a4aa8ac080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:47.944857 7098 tablet_service.cc:1467] Processing CreateTablet for tablet df7e46934567465fa5d838a4aa8ac080 (DEFAULT_TABLE table=test-table [id=a9f0ad4c0f4b4e40850eb2826d260ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:47.944856 6955 tablet_service.cc:1467] Processing CreateTablet for tablet df7e46934567465fa5d838a4aa8ac080 (DEFAULT_TABLE table=test-table [id=a9f0ad4c0f4b4e40850eb2826d260ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:47.945935 6955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7e46934567465fa5d838a4aa8ac080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:47.945935 7098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7e46934567465fa5d838a4aa8ac080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:47.951465 7325 tablet_bootstrap.cc:492] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Bootstrap starting.
I20260810 14:30:47.954104 7325 tablet_bootstrap.cc:654] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:47.954457 7327 tablet_bootstrap.cc:492] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Bootstrap starting.
I20260810 14:30:47.954948 7325 log.cc:824] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:47.955703 7326 tablet_bootstrap.cc:492] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916: Bootstrap starting.
I20260810 14:30:47.956679 7327 tablet_bootstrap.cc:654] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:47.957381 7325 tablet_bootstrap.cc:492] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: No bootstrap required, opened a new log
I20260810 14:30:47.957376 7327 log.cc:824] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:47.957592 7325 ts_tablet_manager.cc:1397] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:30:47.957912 7326 tablet_bootstrap.cc:654] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:47.958731 7326 log.cc:824] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:47.959437 7327 tablet_bootstrap.cc:492] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: No bootstrap required, opened a new log
I20260810 14:30:47.959702 7327 ts_tablet_manager.cc:1397] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260810 14:30:47.960839 7326 tablet_bootstrap.cc:492] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916: No bootstrap required, opened a new log
I20260810 14:30:47.961081 7326 ts_tablet_manager.cc:1397] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:30:47.962569 7325 raft_consensus.cc:348] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:47.962875 7325 raft_consensus.cc:374] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:47.962939 7325 raft_consensus.cc:729] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960bf7aa9e9b49199ad298a1e4c6c59d, State: Initialized, Role: FOLLOWER
I20260810 14:30:47.963421 7325 consensus_queue.cc:260] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:47.963503 7327 raft_consensus.cc:348] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:47.963799 7327 raft_consensus.cc:374] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:47.963861 7327 raft_consensus.cc:729] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a80254164ead4fecb130ab6fe08994e4, State: Initialized, Role: FOLLOWER
I20260810 14:30:47.964473 7327 consensus_queue.cc:260] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:47.964653 7325 ts_tablet_manager.cc:1428] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 14:30:47.964741 7308 heartbeater.cc:503] Master 127.1.206.126:45625 was elected leader, sending a full tablet report...
I20260810 14:30:47.965430 7327 ts_tablet_manager.cc:1428] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:30:47.965492 7326 raft_consensus.cc:348] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:47.965777 7326 raft_consensus.cc:374] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:47.965793 7168 heartbeater.cc:503] Master 127.1.206.126:45625 was elected leader, sending a full tablet report...
I20260810 14:30:47.965858 7326 raft_consensus.cc:729] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aedc21a76e3441db4ce9080249bf916, State: Initialized, Role: FOLLOWER
I20260810 14:30:47.966331 7326 consensus_queue.cc:260] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:47.967268 7326 ts_tablet_manager.cc:1428] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:30:47.967626 7026 heartbeater.cc:503] Master 127.1.206.126:45625 was elected leader, sending a full tablet report...
W20260810 14:30:47.970109 7169 tablet.cc:2369] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:30:48.038247 7027 tablet.cc:2369] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:48.096537 7332 raft_consensus.cc:482] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:48.096781 7332 raft_consensus.cc:504] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:48.098032 7332 leader_election.cc:288] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 960bf7aa9e9b49199ad298a1e4c6c59d (127.1.206.67:44419), 6aedc21a76e3441db4ce9080249bf916 (127.1.206.65:36925)
I20260810 14:30:48.100198 7171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.098256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:44419 (local address 127.1.206.66:56401)
0810 14:30:48.098492 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:48.098510 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:48.098602 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:48.098920 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:48.098924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:48.098940 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:48.099463 (+ 523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:48.099466 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:48.099480 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:48.099512 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:48.099856 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:48.099860 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:48.099864 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:30:48.099972 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 14:30:48.100031 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260810 14:30:48.100232 7321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.098384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:56401 (local address 127.1.206.67:44419)
0810 14:30:48.098540 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:48.098544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:48.098563 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:30:48.098732 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:48.098735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:48.098796 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:48.098899 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:48.099675 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:48.099679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:48.099682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:48.099695 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:48.099719 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:48.099729 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:48.099830 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:48.100050 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 14:30:48.100098 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:30:48.100245 7324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.098692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:59877 (local address 127.1.206.65:36925)
0810 14:30:48.098852 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:48.098859 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:48.098875 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:30:48.099006 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:48.099010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:48.099051 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:48.099150 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:48.099678 (+ 528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:48.099681 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:48.099684 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:48.099696 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:48.099719 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:48.099729 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:48.099844 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:48.100050 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 14:30:48.100098 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 14:30:48.100209 7334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.098354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:36925 (local address 127.1.206.66:59877)
0810 14:30:48.098792 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:48.098806 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:48.098891 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:48.099183 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:48.099185 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:48.099197 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:48.099521 (+ 324us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:30:48.099523 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:48.099530 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:30:48.099554 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:48.099856 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:48.099860 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:48.099864 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:30:48.099980 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 14:30:48.100044 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":24,"thread_start_us":129,"threads_started":1}
I20260810 14:30:48.100909 6977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7e46934567465fa5d838a4aa8ac080" candidate_uuid: "a80254164ead4fecb130ab6fe08994e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aedc21a76e3441db4ce9080249bf916" is_pre_election: true
I20260810 14:30:48.101164 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7e46934567465fa5d838a4aa8ac080" candidate_uuid: "a80254164ead4fecb130ab6fe08994e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" is_pre_election: true
I20260810 14:30:48.101257 6977 raft_consensus.cc:2454] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a80254164ead4fecb130ab6fe08994e4 in term 0.
I20260810 14:30:48.101431 7258 raft_consensus.cc:2454] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a80254164ead4fecb130ab6fe08994e4 in term 0.
I20260810 14:30:48.101805 7048 leader_election.cc:302] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6aedc21a76e3441db4ce9080249bf916, 960bf7aa9e9b49199ad298a1e4c6c59d, a80254164ead4fecb130ab6fe08994e4; no voters:
I20260810 14:30:48.102154 7332 raft_consensus.cc:2781] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:48.102240 7332 raft_consensus.cc:482] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:48.102272 7332 raft_consensus.cc:3037] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:48.103404 7332 raft_consensus.cc:504] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:48.103824 7332 leader_election.cc:288] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [CANDIDATE]: Term 1 election: Requested vote from peers 960bf7aa9e9b49199ad298a1e4c6c59d (127.1.206.67:44419), 6aedc21a76e3441db4ce9080249bf916 (127.1.206.65:36925)
I20260810 14:30:48.104351 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7e46934567465fa5d838a4aa8ac080" candidate_uuid: "a80254164ead4fecb130ab6fe08994e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d"
I20260810 14:30:48.104351 6977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7e46934567465fa5d838a4aa8ac080" candidate_uuid: "a80254164ead4fecb130ab6fe08994e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aedc21a76e3441db4ce9080249bf916"
I20260810 14:30:48.104501 7258 raft_consensus.cc:3037] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:48.104560 6977 raft_consensus.cc:3037] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:48.105997 6977 raft_consensus.cc:2454] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a80254164ead4fecb130ab6fe08994e4 in term 1.
I20260810 14:30:48.105997 7258 raft_consensus.cc:2454] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a80254164ead4fecb130ab6fe08994e4 in term 1.
I20260810 14:30:48.106410 7046 leader_election.cc:302] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 960bf7aa9e9b49199ad298a1e4c6c59d, a80254164ead4fecb130ab6fe08994e4; no voters:
I20260810 14:30:48.106609 7332 raft_consensus.cc:2781] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:48.106871 7332 raft_consensus.cc:686] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 1 LEADER]: Becoming Leader. State: Replica: a80254164ead4fecb130ab6fe08994e4, State: Running, Role: LEADER
I20260810 14:30:48.107277 7332 consensus_queue.cc:237] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } }
I20260810 14:30:48.111034 6827 catalog_manager.cc:5495] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a80254164ead4fecb130ab6fe08994e4 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "a80254164ead4fecb130ab6fe08994e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a80254164ead4fecb130ab6fe08994e4" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 } health_report { overall_health: UNKNOWN } } }
I20260810 14:30:48.133252 7323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.131519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42002 (local address 127.1.206.66:36621)
0810 14:30:48.131674 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:48.131679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:48.131696 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:30:48.131801 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:48.131804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:48.131871 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:48.131970 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:48.132830 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:48.132833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:48.132836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:48.132848 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:48.132875 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:48.132883 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:48.132983 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:48.133055 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 14:30:48.133098 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 14:30:48.139222 7258 raft_consensus.cc:1261] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 1 FOLLOWER]: Refusing update from remote peer a80254164ead4fecb130ab6fe08994e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:48.139222 6977 raft_consensus.cc:1261] T df7e46934567465fa5d838a4aa8ac080 P 6aedc21a76e3441db4ce9080249bf916 [term 1 FOLLOWER]: Refusing update from remote peer a80254164ead4fecb130ab6fe08994e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:48.140002 7336 consensus_queue.cc:1035] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "960bf7aa9e9b49199ad298a1e4c6c59d" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 44419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:48.140208 7332 consensus_queue.cc:1035] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aedc21a76e3441db4ce9080249bf916" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 14:30:48.148770 7309 tablet.cc:2369] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:48.149279 7340 mvcc.cc:205] Tried to move back new op lower bound from 7316980728370925568 to 7316980728250101760. Current Snapshot: MvccSnapshot[applied={T|T < 7316980728370925568}]
I20260810 14:30:48.149863 7342 mvcc.cc:205] Tried to move back new op lower bound from 7316980728370925568 to 7316980728250101760. Current Snapshot: MvccSnapshot[applied={T|T < 7316980728370925568}]
I20260810 14:30:48.160382 6827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:48.160593 6827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:48.163539 6827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3740b2027f58497b9157d3a63d72700b: Sending DeleteTablet for 3 replicas of tablet df7e46934567465fa5d838a4aa8ac080
I20260810 14:30:48.164529 7237 tablet_service.cc:1514] Processing DeleteTablet for tablet df7e46934567465fa5d838a4aa8ac080 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:48 UTC) from {username='slave'} at 127.0.0.1:35888
I20260810 14:30:48.164570 6955 tablet_service.cc:1514] Processing DeleteTablet for tablet df7e46934567465fa5d838a4aa8ac080 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:48 UTC) from {username='slave'} at 127.0.0.1:40370
I20260810 14:30:48.165117 7351 tablet_replica.cc:330] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: stopping tablet replica
I20260810 14:30:48.165097 7098 tablet_service.cc:1514] Processing DeleteTablet for tablet df7e46934567465fa5d838a4aa8ac080 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:48 UTC) from {username='slave'} at 127.0.0.1:41992
I20260810 14:30:48.165504 7351 raft_consensus.cc:2229] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:48.165669 7352 tablet_replica.cc:330] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: stopping tablet replica
I20260810 14:30:48.165889 7351 raft_consensus.cc:2258] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:48.165905 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 6890
I20260810 14:30:48.171036 7352 raft_consensus.cc:2229] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:48.171643 7352 raft_consensus.cc:2258] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:48.173535 7352 ts_tablet_manager.cc:1905] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:48.173535 7351 ts_tablet_manager.cc:1905] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:48.176539 7351 ts_tablet_manager.cc:1918] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:48.176539 7352 ts_tablet_manager.cc:1918] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:48.176672 7352 log.cc:1196] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/df7e46934567465fa5d838a4aa8ac080
I20260810 14:30:48.176672 7351 log.cc:1196] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/df7e46934567465fa5d838a4aa8ac080
I20260810 14:30:48.177030 7351 ts_tablet_manager.cc:1939] T df7e46934567465fa5d838a4aa8ac080 P 960bf7aa9e9b49199ad298a1e4c6c59d: Deleting consensus metadata
I20260810 14:30:48.177030 7352 ts_tablet_manager.cc:1939] T df7e46934567465fa5d838a4aa8ac080 P a80254164ead4fecb130ab6fe08994e4: Deleting consensus metadata
I20260810 14:30:48.178454 6813 catalog_manager.cc:4841] TS a80254164ead4fecb130ab6fe08994e4 (127.1.206.66:36621): tablet df7e46934567465fa5d838a4aa8ac080 (table test-table [id=a9f0ad4c0f4b4e40850eb2826d260ec9]) successfully deleted
I20260810 14:30:48.178761 6811 catalog_manager.cc:4841] TS 960bf7aa9e9b49199ad298a1e4c6c59d (127.1.206.67:44419): tablet df7e46934567465fa5d838a4aa8ac080 (table test-table [id=a9f0ad4c0f4b4e40850eb2826d260ec9]) successfully deleted
W20260810 14:30:48.180462 6813 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:36925 (error 108)
I20260810 14:30:48.180688 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7030
I20260810 14:30:48.185470 7320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.185142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:36925 (local address 127.0.0.1:40376)
0810 14:30:48.185289 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:48.185385 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:36925: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260810 14:30:48.185672 6813 catalog_manager.cc:4584] TS 6aedc21a76e3441db4ce9080249bf916 (127.1.206.65:36925): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df7e46934567465fa5d838a4aa8ac080: Network error: Client connection negotiation failed: client connection to 127.1.206.65:36925: connect: Connection refused (error 111)
I20260810 14:30:48.190388 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7172
I20260810 14:30:48.198505 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 6794
2026-08-10T14:30:48Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1166 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 14:30:48.223560 1849 mini_oidc.cc:152] Starting JWKS server
I20260810 14:30:48.226369 1849 webserver.cc:460] Webserver started at https://127.0.0.1:45505/ using document root <none> and password file <none>
I20260810 14:30:48.226604 1849 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 14:30:48.226954 1849 webserver.cc:460] Webserver started at http://127.0.0.1:42513/ using document root <none> and password file <none>
2026-08-10T14:30:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:48Z Disabled control of system clock
I20260810 14:30:48.238222 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:36095
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:45997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:36095
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45505/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/testchainca.cert with env {}
W20260810 14:30:48.351702 7359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:48.352072 7359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:48.352157 7359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:48.356395 7359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:48.356508 7359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:48.356535 7359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:48.356573 7359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:48.356608 7359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:30:48.356644 7359 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:30:48.356675 7359 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45505/jwks.json
I20260810 14:30:48.362429 7359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:36095
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:36095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45505/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:48.363961 7359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:48.365345 7359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:48.376125 7368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:48.376284 7365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:48.376128 7366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:48.376657 7359 server_base.cc:1034] running on GCE node
I20260810 14:30:48.377409 7359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:48.379299 7359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:48.380527 7359 hybrid_clock.cc:648] HybridClock initialized: now 1786372248380489 us; error 44 us; skew 500 ppm
I20260810 14:30:48.382710 7359 webserver.cc:460] Webserver started at http://127.1.206.126:45033/ using document root <none> and password file <none>
I20260810 14:30:48.383273 7359 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:48.383338 7359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:48.383512 7359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:48.385677 7359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "185daa7e01eb42ad848551ba950d2d25"
format_stamp: "Formatted at 2026-08-10 14:30:48 on dist-test-slave-0b58"
server_key: "9203d60d53cd9866b3af972286803327"
server_key_iv: "0eb739b343df546509f3dff21145255d"
server_key_version: "encryptionkey@0"
I20260810 14:30:48.386299 7359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "185daa7e01eb42ad848551ba950d2d25"
format_stamp: "Formatted at 2026-08-10 14:30:48 on dist-test-slave-0b58"
server_key: "9203d60d53cd9866b3af972286803327"
server_key_iv: "0eb739b343df546509f3dff21145255d"
server_key_version: "encryptionkey@0"
I20260810 14:30:48.390156 7359 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:48.392683 7374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:48.393873 7359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:48.394006 7359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "185daa7e01eb42ad848551ba950d2d25"
format_stamp: "Formatted at 2026-08-10 14:30:48 on dist-test-slave-0b58"
server_key: "9203d60d53cd9866b3af972286803327"
server_key_iv: "0eb739b343df546509f3dff21145255d"
server_key_version: "encryptionkey@0"
I20260810 14:30:48.394141 7359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:48.414333 7359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:48.415092 7359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:48.415310 7359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:48.422654 7359 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:36095
I20260810 14:30:48.422664 7429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:36095 every 8 connection(s)
I20260810 14:30:48.423663 7359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:48.424933 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7359
I20260810 14:30:48.425067 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:48.425359 1849 external_mini_cluster.cc:1428] Setting key b829fc2779e7b24c9985bd08acaa190d
I20260810 14:30:48.427662 7431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:48.434407 7431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25: Bootstrap starting.
I20260810 14:30:48.435151 7435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.426714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34826 (local address 127.1.206.126:36095)
0810 14:30:48.427331 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:48.427347 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:48.427383 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:30:48.428113 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:48.428131 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:48.428579 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:48.428869 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:48.429258 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.430249 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.431488 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.432033 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.432172 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:48.433178 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:48.433183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:48.433197 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:48.433620 (+ 423us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:48.433688 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:48.433709 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:48.433798 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:48.433985 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 14:30:48.434311 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":159,"threads_started":1}
I20260810 14:30:48.437011 7431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:48.437882 7431 log.cc:824] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:48.438314 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:30:48.440100 7431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25: No bootstrap required, opened a new log
I20260810 14:30:48.443686 7431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185daa7e01eb42ad848551ba950d2d25" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36095 } }
I20260810 14:30:48.443998 7431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:48.444063 7431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 185daa7e01eb42ad848551ba950d2d25, State: Initialized, Role: FOLLOWER
I20260810 14:30:48.444535 7431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185daa7e01eb42ad848551ba950d2d25" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36095 } }
I20260810 14:30:48.444664 7431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:48.444705 7431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:48.444787 7431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:48.445916 7431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185daa7e01eb42ad848551ba950d2d25" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36095 } }
I20260810 14:30:48.446346 7431 leader_election.cc:302] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 185daa7e01eb42ad848551ba950d2d25; no voters:
I20260810 14:30:48.446813 7431 leader_election.cc:288] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:48.446961 7437 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:48.447237 7437 raft_consensus.cc:686] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [term 1 LEADER]: Becoming Leader. State: Replica: 185daa7e01eb42ad848551ba950d2d25, State: Running, Role: LEADER
I20260810 14:30:48.447640 7437 consensus_queue.cc:237] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185daa7e01eb42ad848551ba950d2d25" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36095 } }
I20260810 14:30:48.448467 7431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:48.449661 7438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "185daa7e01eb42ad848551ba950d2d25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185daa7e01eb42ad848551ba950d2d25" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36095 } } }
I20260810 14:30:48.449824 7438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:48.450434 7446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:48.450822 7439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 185daa7e01eb42ad848551ba950d2d25. Latest consensus state: current_term: 1 leader_uuid: "185daa7e01eb42ad848551ba950d2d25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "185daa7e01eb42ad848551ba950d2d25" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36095 } } }
I20260810 14:30:48.450934 7439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:48.454070 7446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:48.460191 7446 catalog_manager.cc:1347] Generated new cluster ID: 8268007f6807416eb198e35eed11b081
I20260810 14:30:48.460335 7446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:48.477246 7446 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:48.478366 7446 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:48.488855 7446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 185daa7e01eb42ad848551ba950d2d25: Generated new TSK 0
I20260810 14:30:48.489688 7446 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 14:30:48.526638 7462 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 14:30:48.526832 7462 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 14:30:48.527455 7435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.506852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34836 (local address 127.1.206.126:36095)
0810 14:30:48.507004 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:48.507009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:48.507223 (+ 214us) server_negotiation.cc:407] Connection header received
0810 14:30:48.507441 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:48.507445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:48.507507 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:48.507630 (+ 123us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:30:48.507961 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.508849 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.509805 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.510174 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.510281 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:48.510672 (+ 391us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:30:48.526989 (+ 16317us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45505/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 14:30:48.527309 (+ 320us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34836: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45505/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 14:30:48.527524 7435 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34836: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45505/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 14:30:48.528903 7461 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:48.506739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:36095 (local address 127.0.0.1:34836)
0810 14:30:48.507126 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:48.507147 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:48.507268 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:48.507692 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:48.507695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:48.507709 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:30:48.507839 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:48.507845 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.508981 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.508984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:48.509677 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:48.509686 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.510308 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.510333 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:48.510410 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:48.510461 (+ 51us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:30:48.527289 (+ 16828us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45505/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 14:30:48.527528 (+ 239us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.206.126:36095: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45505/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":129,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.1.206.126:36095: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45505/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 14:30:48.529735 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7359
2026-08-10T14:30:48Z chronyd exiting
I20260810 14:30:48.570499 1849 test_util.cc:175] -----------------------------------------------
I20260810 14:30:48.570592 1849 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786372219863018-1849-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (349 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 14:30:48.571710 1849 mini_oidc.cc:152] Starting JWKS server
I20260810 14:30:48.572688 1849 webserver.cc:460] Webserver started at https://127.0.0.1:32949/ using document root <none> and password file <none>
I20260810 14:30:48.572831 1849 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 14:30:48.573112 1849 webserver.cc:460] Webserver started at http://127.0.0.1:36515/ using document root <none> and password file <none>
2026-08-10T14:30:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:48Z Disabled control of system clock
I20260810 14:30:48.584221 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39051
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:45729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39051
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32949/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/testchainca.cert with env {}
W20260810 14:30:48.699494 7469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:48.699775 7469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:48.699868 7469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:48.703941 7469 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:48.704017 7469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:48.704032 7469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:48.704066 7469 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:48.704080 7469 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:30:48.704097 7469 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:30:48.704110 7469 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:32949/jwks.json
I20260810 14:30:48.709610 7469 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39051
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:32949/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:48.710773 7469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:48.711750 7469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:48.720605 7474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:48.720598 7476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:48.720847 7469 server_base.cc:1034] running on GCE node
W20260810 14:30:48.720598 7478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:48.721951 7469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:48.723165 7469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:48.724362 7469 hybrid_clock.cc:648] HybridClock initialized: now 1786372248724342 us; error 34 us; skew 500 ppm
I20260810 14:30:48.726342 7469 webserver.cc:460] Webserver started at http://127.1.206.126:35217/ using document root <none> and password file <none>
I20260810 14:30:48.726958 7469 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:48.727057 7469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:48.727300 7469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:48.729525 7469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "d6eed81d302445adaaeb7ffef30d0acc"
format_stamp: "Formatted at 2026-08-10 14:30:48 on dist-test-slave-0b58"
server_key: "b31e751dc9287d17528baab8ffbe3002"
server_key_iv: "8526e1979f52ee92dd0f69a55384934d"
server_key_version: "encryptionkey@0"
I20260810 14:30:48.730129 7469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "d6eed81d302445adaaeb7ffef30d0acc"
format_stamp: "Formatted at 2026-08-10 14:30:48 on dist-test-slave-0b58"
server_key: "b31e751dc9287d17528baab8ffbe3002"
server_key_iv: "8526e1979f52ee92dd0f69a55384934d"
server_key_version: "encryptionkey@0"
I20260810 14:30:48.734117 7469 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:48.736770 7484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:48.737993 7469 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:48.738161 7469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "d6eed81d302445adaaeb7ffef30d0acc"
format_stamp: "Formatted at 2026-08-10 14:30:48 on dist-test-slave-0b58"
server_key: "b31e751dc9287d17528baab8ffbe3002"
server_key_iv: "8526e1979f52ee92dd0f69a55384934d"
server_key_version: "encryptionkey@0"
I20260810 14:30:48.738293 7469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:48.751123 7469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:48.751891 7469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:48.752105 7469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:48.759645 7469 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39051
I20260810 14:30:48.759657 7539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39051 every 8 connection(s)
I20260810 14:30:48.760710 7469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:48.761035 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7469
I20260810 14:30:48.761135 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:48.761529 1849 external_mini_cluster.cc:1428] Setting key 99345f37e302573d78a18092d5941a28
I20260810 14:30:48.764384 7540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:48.770300 7540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc: Bootstrap starting.
I20260810 14:30:48.770925 7543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.762961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38564 (local address 127.1.206.126:39051)
0810 14:30:48.763618 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:48.763634 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:48.763669 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:30:48.764395 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:48.764414 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:48.764861 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:48.765194 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:48.765626 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.766612 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.767506 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.767991 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.768167 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:48.769130 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:48.769135 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:48.769147 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:48.769526 (+ 379us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:48.769582 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:48.769603 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:48.769711 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:48.769884 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 14:30:48.770138 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":155,"threads_started":1}
I20260810 14:30:48.772626 7540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:48.773547 7540 log.cc:824] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:48.773795 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:30:48.775642 7540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc: No bootstrap required, opened a new log
I20260810 14:30:48.779287 7540 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6eed81d302445adaaeb7ffef30d0acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39051 } }
I20260810 14:30:48.779536 7540 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:48.779572 7540 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6eed81d302445adaaeb7ffef30d0acc, State: Initialized, Role: FOLLOWER
I20260810 14:30:48.779942 7540 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6eed81d302445adaaeb7ffef30d0acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39051 } }
I20260810 14:30:48.780058 7540 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:48.780098 7540 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:48.780170 7540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:48.781180 7540 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6eed81d302445adaaeb7ffef30d0acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39051 } }
I20260810 14:30:48.781615 7540 leader_election.cc:302] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6eed81d302445adaaeb7ffef30d0acc; no voters:
I20260810 14:30:48.781977 7540 leader_election.cc:288] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:48.782140 7545 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:48.782407 7545 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [term 1 LEADER]: Becoming Leader. State: Replica: d6eed81d302445adaaeb7ffef30d0acc, State: Running, Role: LEADER
I20260810 14:30:48.782732 7545 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6eed81d302445adaaeb7ffef30d0acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39051 } }
I20260810 14:30:48.783332 7540 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:48.784576 7547 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6eed81d302445adaaeb7ffef30d0acc. Latest consensus state: current_term: 1 leader_uuid: "d6eed81d302445adaaeb7ffef30d0acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6eed81d302445adaaeb7ffef30d0acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39051 } } }
I20260810 14:30:48.784749 7547 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:48.785070 7546 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6eed81d302445adaaeb7ffef30d0acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6eed81d302445adaaeb7ffef30d0acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39051 } } }
I20260810 14:30:48.785185 7546 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:48.785284 7554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:48.788730 7554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:48.794536 7554 catalog_manager.cc:1347] Generated new cluster ID: 0d54eb3c3e29477aa15c80f1260aa612
I20260810 14:30:48.794611 7554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:48.804780 7554 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:48.805938 7554 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:48.811854 7554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6eed81d302445adaaeb7ffef30d0acc: Generated new TSK 0
I20260810 14:30:48.812705 7554 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 14:30:48.837329 7570 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 14:30:48.837443 7570 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 14:30:48.838214 7543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:48.822035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38566 (local address 127.1.206.126:39051)
0810 14:30:48.822173 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:48.822178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:48.822359 (+ 181us) server_negotiation.cc:407] Connection header received
0810 14:30:48.822523 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:48.822527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:48.822585 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:48.822703 (+ 118us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:30:48.822911 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.823720 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.824715 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.825075 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.825183 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:48.825462 (+ 279us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:30:48.837734 (+ 12272us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 14:30:48.838050 (+ 316us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38566: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 14:30:48.838290 7543 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38566: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 14:30:48.838302 7569 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:48.821912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39051 (local address 127.0.0.1:38566)
0810 14:30:48.822273 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:48.822286 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:48.822389 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:48.822708 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:48.822710 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:48.822716 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:30:48.822811 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:48.822815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.823861 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.823864 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:48.824598 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:48.824607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:48.825188 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:48.825191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:48.825254 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:48.825282 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:30:48.837976 (+ 12694us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 14:30:48.838129 (+ 153us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.206.126:39051: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:32949/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":150,"threads_started":1}
I20260810 14:30:48.838742 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7469
2026-08-10T14:30:48Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (310 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 14:30:48.881935 1849 mini_oidc.cc:152] Starting JWKS server
I20260810 14:30:48.882797 1849 webserver.cc:460] Webserver started at https://127.0.0.1:46409/ using document root <none> and password file <none>
I20260810 14:30:48.882884 1849 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 14:30:48.883152 1849 webserver.cc:460] Webserver started at http://127.0.0.1:41875/ using document root <none> and password file <none>
2026-08-10T14:30:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:48Z Disabled control of system clock
I20260810 14:30:48.893651 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43185
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:45815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:43185
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46409/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 14:30:49.009399 7576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:49.009740 7576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:49.009819 7576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:49.014005 7576 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:49.014099 7576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:49.014130 7576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:49.014171 7576 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:49.014214 7576 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:30:49.014250 7576 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:30:49.014283 7576 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46409/jwks.json
I20260810 14:30:49.019158 7576 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:43185
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46409/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:49.020391 7576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:49.021831 7576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:49.030558 7581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:49.030750 7576 server_base.cc:1034] running on GCE node
W20260810 14:30:49.030586 7582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:49.030558 7584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:49.031615 7576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:49.032776 7576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:49.033949 7576 hybrid_clock.cc:648] HybridClock initialized: now 1786372249033920 us; error 42 us; skew 500 ppm
I20260810 14:30:49.035882 7576 webserver.cc:460] Webserver started at http://127.1.206.126:34277/ using document root <none> and password file <none>
I20260810 14:30:49.036550 7576 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:49.036621 7576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:49.036792 7576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:49.038930 7576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "d1ac303c5af847df950ce063b5166f46"
format_stamp: "Formatted at 2026-08-10 14:30:49 on dist-test-slave-0b58"
server_key: "845cf91a33a56e7b45f57380ebfb85b6"
server_key_iv: "dbdea6e39fca5d9f9a787278a219ed8a"
server_key_version: "encryptionkey@0"
I20260810 14:30:49.039511 7576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "d1ac303c5af847df950ce063b5166f46"
format_stamp: "Formatted at 2026-08-10 14:30:49 on dist-test-slave-0b58"
server_key: "845cf91a33a56e7b45f57380ebfb85b6"
server_key_iv: "dbdea6e39fca5d9f9a787278a219ed8a"
server_key_version: "encryptionkey@0"
I20260810 14:30:49.043512 7576 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:49.046020 7590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:49.047286 7576 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:30:49.047451 7576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "d1ac303c5af847df950ce063b5166f46"
format_stamp: "Formatted at 2026-08-10 14:30:49 on dist-test-slave-0b58"
server_key: "845cf91a33a56e7b45f57380ebfb85b6"
server_key_iv: "dbdea6e39fca5d9f9a787278a219ed8a"
server_key_version: "encryptionkey@0"
I20260810 14:30:49.047564 7576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:49.080229 7576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:49.081058 7576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:49.081267 7576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:49.089035 7576 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:43185
I20260810 14:30:49.089071 7643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:43185 every 8 connection(s)
I20260810 14:30:49.090004 7576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:49.090821 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7576
I20260810 14:30:49.090961 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:49.091292 1849 external_mini_cluster.cc:1428] Setting key ae76d330198f44516fdf59aac1d1af9c
I20260810 14:30:49.093788 7644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:49.099498 7644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46: Bootstrap starting.
I20260810 14:30:49.100736 7647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:49.092697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45380 (local address 127.1.206.126:43185)
0810 14:30:49.093361 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:49.093376 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:49.093413 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:30:49.094133 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:49.094152 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:49.094539 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:49.094888 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:49.095308 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.096355 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.097252 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.097722 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.097900 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:49.098831 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:49.098836 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:49.098848 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:49.099225 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:49.099280 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:49.099299 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:49.099416 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:49.099573 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 14:30:49.099866 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":156,"threads_started":1}
I20260810 14:30:49.102223 7644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:49.103096 7644 log.cc:824] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:49.103595 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:30:49.105286 7644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46: No bootstrap required, opened a new log
I20260810 14:30:49.108860 7644 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ac303c5af847df950ce063b5166f46" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43185 } }
I20260810 14:30:49.109092 7644 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:49.109163 7644 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1ac303c5af847df950ce063b5166f46, State: Initialized, Role: FOLLOWER
I20260810 14:30:49.109613 7644 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ac303c5af847df950ce063b5166f46" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43185 } }
I20260810 14:30:49.109737 7644 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:49.109824 7644 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:49.109922 7644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:49.110916 7644 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ac303c5af847df950ce063b5166f46" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43185 } }
I20260810 14:30:49.111263 7644 leader_election.cc:302] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1ac303c5af847df950ce063b5166f46; no voters:
I20260810 14:30:49.111622 7644 leader_election.cc:288] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:49.111755 7649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:49.112010 7649 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [term 1 LEADER]: Becoming Leader. State: Replica: d1ac303c5af847df950ce063b5166f46, State: Running, Role: LEADER
I20260810 14:30:49.112367 7649 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ac303c5af847df950ce063b5166f46" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43185 } }
I20260810 14:30:49.113024 7644 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:49.114218 7650 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1ac303c5af847df950ce063b5166f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ac303c5af847df950ce063b5166f46" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43185 } } }
I20260810 14:30:49.114226 7651 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1ac303c5af847df950ce063b5166f46. Latest consensus state: current_term: 1 leader_uuid: "d1ac303c5af847df950ce063b5166f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1ac303c5af847df950ce063b5166f46" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43185 } } }
I20260810 14:30:49.114389 7650 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:49.114389 7651 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:49.114843 7658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:49.118153 7658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:49.124336 7658 catalog_manager.cc:1347] Generated new cluster ID: 68bb0fe7f2694557a0e9c05509e1f7d0
I20260810 14:30:49.124423 7658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:49.139465 7658 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:49.140522 7658 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:49.146839 7658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1ac303c5af847df950ce063b5166f46: Generated new TSK 0
I20260810 14:30:49.147716 7658 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:30:49.173768 7647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:49.168394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45382 (local address 127.1.206.126:43185)
0810 14:30:49.168524 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:49.168528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:49.168702 (+ 174us) server_negotiation.cc:407] Connection header received
0810 14:30:49.168889 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:49.168892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:49.168943 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:49.169039 (+ 96us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:30:49.169312 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.169860 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.171125 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.171351 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.171447 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:49.171807 (+ 360us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:30:49.173360 (+ 1553us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46409/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 14:30:49.173618 (+ 258us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45382: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46409/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 14:30:49.173848 7647 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45382: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46409/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 14:30:49.175628 7673 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:49.168199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43185 (local address 127.0.0.1:45382)
0810 14:30:49.168595 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:49.168612 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:49.168743 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:49.169066 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:49.169070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:49.169078 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:30:49.169199 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:49.169206 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.169974 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.169978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:49.170966 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:49.170978 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.171492 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.171496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:49.171598 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:49.171629 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:30:49.173544 (+ 1915us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46409/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 14:30:49.175423 (+ 1879us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.206.126:43185: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46409/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":1643,"thread_start_us":143,"threads_started":1}
I20260810 14:30:49.176041 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7576
E20260810 14:30:49.188781 7674 webserver.cc:533] Webserver: sslize failed:
E20260810 14:30:49.188894 7674 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T14:30:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (337 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T14:30:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:49Z Disabled control of system clock
I20260810 14:30:49.229427 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:41553
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:35461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:41553
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/testchainca.cert with env {}
W20260810 14:30:49.345777 7679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:49.346050 7679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:49.346112 7679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:49.350252 7679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:49.350332 7679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:49.350347 7679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:49.350365 7679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:49.350381 7679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:30:49.350397 7679 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:30:49.350410 7679 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 14:30:49.355780 7679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:35461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:41553
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:41553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:49.356849 7679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:49.357798 7679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:30:49.366677 7679 server_base.cc:1034] running on GCE node
W20260810 14:30:49.366626 7686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:49.366626 7685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:49.366628 7688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:49.367552 7679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:49.368801 7679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:49.370012 7679 hybrid_clock.cc:648] HybridClock initialized: now 1786372249369979 us; error 52 us; skew 500 ppm
I20260810 14:30:49.375793 7679 webserver.cc:460] Webserver started at http://127.1.206.126:33395/ using document root <none> and password file <none>
I20260810 14:30:49.376528 7679 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:49.376632 7679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:49.376863 7679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:49.379232 7679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "1a70e8b6223048d3801fce3a573273f0"
format_stamp: "Formatted at 2026-08-10 14:30:49 on dist-test-slave-0b58"
server_key: "baf41e971951f2a6e4d0e5add43bc3df"
server_key_iv: "2703ee156474ae3eba416f01aabad994"
server_key_version: "encryptionkey@0"
I20260810 14:30:49.379940 7679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "1a70e8b6223048d3801fce3a573273f0"
format_stamp: "Formatted at 2026-08-10 14:30:49 on dist-test-slave-0b58"
server_key: "baf41e971951f2a6e4d0e5add43bc3df"
server_key_iv: "2703ee156474ae3eba416f01aabad994"
server_key_version: "encryptionkey@0"
I20260810 14:30:49.383997 7679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:30:49.386802 7694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:49.388129 7679 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:49.388356 7679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "1a70e8b6223048d3801fce3a573273f0"
format_stamp: "Formatted at 2026-08-10 14:30:49 on dist-test-slave-0b58"
server_key: "baf41e971951f2a6e4d0e5add43bc3df"
server_key_iv: "2703ee156474ae3eba416f01aabad994"
server_key_version: "encryptionkey@0"
I20260810 14:30:49.388494 7679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:49.404809 7679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:49.405637 7679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:49.405983 7679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:49.414176 7679 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:41553
I20260810 14:30:49.414196 7750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:41553 every 8 connection(s)
I20260810 14:30:49.415242 7679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:49.416029 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7679
I20260810 14:30:49.416167 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:49.416507 1849 external_mini_cluster.cc:1428] Setting key 90de34bd337bd88ccefacf87fe11e9f5
I20260810 14:30:49.418697 7751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:49.424746 7751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0: Bootstrap starting.
I20260810 14:30:49.426152 7755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:49.417856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60532 (local address 127.1.206.126:41553)
0810 14:30:49.418537 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:49.418559 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:49.418618 (+ 59us) server_negotiation.cc:407] Connection header received
0810 14:30:49.419339 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:49.419356 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:49.419781 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:49.420121 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:49.420584 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.421598 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.422518 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.423021 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.423211 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:49.424331 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:49.424338 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:49.424351 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:30:49.424759 (+ 408us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:49.424818 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:30:49.424840 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:49.424954 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:49.425116 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 14:30:49.425385 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":139,"threads_started":1}
I20260810 14:30:49.427409 7751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:49.428335 7751 log.cc:824] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:49.429344 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:30:49.430620 7751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0: No bootstrap required, opened a new log
I20260810 14:30:49.434199 7751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70e8b6223048d3801fce3a573273f0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41553 } }
I20260810 14:30:49.434469 7751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:49.434557 7751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a70e8b6223048d3801fce3a573273f0, State: Initialized, Role: FOLLOWER
I20260810 14:30:49.434993 7751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70e8b6223048d3801fce3a573273f0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41553 } }
I20260810 14:30:49.435154 7751 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:49.435245 7751 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:49.435348 7751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:49.436416 7751 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70e8b6223048d3801fce3a573273f0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41553 } }
I20260810 14:30:49.436755 7751 leader_election.cc:302] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a70e8b6223048d3801fce3a573273f0; no voters:
I20260810 14:30:49.437091 7751 leader_election.cc:288] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:49.437223 7757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:49.437469 7757 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1a70e8b6223048d3801fce3a573273f0, State: Running, Role: LEADER
I20260810 14:30:49.437781 7757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70e8b6223048d3801fce3a573273f0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41553 } }
I20260810 14:30:49.438369 7751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:49.439543 7759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a70e8b6223048d3801fce3a573273f0. Latest consensus state: current_term: 1 leader_uuid: "1a70e8b6223048d3801fce3a573273f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70e8b6223048d3801fce3a573273f0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41553 } } }
I20260810 14:30:49.439697 7759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:49.439992 7758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a70e8b6223048d3801fce3a573273f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70e8b6223048d3801fce3a573273f0" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41553 } } }
I20260810 14:30:49.440093 7758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:49.440198 7766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:49.443259 7766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:49.449018 7766 catalog_manager.cc:1347] Generated new cluster ID: eae08a268d1542cebcaf7e85705dc83f
I20260810 14:30:49.449103 7766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:49.467978 7766 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:49.469205 7766 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:49.475440 7766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a70e8b6223048d3801fce3a573273f0: Generated new TSK 0
I20260810 14:30:49.476184 7766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:30:49.508559 7755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:49.485768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60544 (local address 127.1.206.126:41553)
0810 14:30:49.485917 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:49.485924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:49.486110 (+ 186us) server_negotiation.cc:407] Connection header received
0810 14:30:49.486310 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:49.486313 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:49.486362 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:49.486455 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:30:49.486741 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.487261 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.488551 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.488773 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.488857 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:49.489198 (+ 341us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:30:49.508058 (+ 18860us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 14:30:49.508433 (+ 375us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60544: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 14:30:49.508668 7755 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60544: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 14:30:49.508759 7783 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:49.485669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41553 (local address 127.0.0.1:60544)
0810 14:30:49.486004 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:49.486021 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:49.486154 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:49.486490 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:49.486494 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:49.486502 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:30:49.486627 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:49.486633 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.487399 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.487403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:49.488433 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:49.488444 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:49.488896 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:49.488900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:49.488999 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:49.489028 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:30:49.508331 (+ 19303us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 14:30:49.508548 (+ 217us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.206.126:41553: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":126,"threads_started":1}
I20260810 14:30:49.509625 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7679
2026-08-10T14:30:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (312 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (132 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (130 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:49 dist-test-slave-0b58 krb5kdc[7795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:49 dist-test-slave-0b58 krb5kdc[7795](info): set up 2 sockets
Aug 10 14:30:49 dist-test-slave-0b58 krb5kdc[7795](info): commencing operation
krb5kdc: starting...
W20260810 14:30:50.878665 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:50 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:30:51.008615 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:42917
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:42917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:51.129614 7809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:51.129944 7809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:51.129992 7809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:51.134441 7809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:51.134518 7809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:51.134538 7809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:51.134554 7809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:51.134570 7809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:51.140129 7809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:42917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:42917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:51.141268 7809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:51.142252 7809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:51.151134 7814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.151134 7815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.151300 7817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:51.151403 7809 server_base.cc:1034] running on GCE node
I20260810 14:30:51.152117 7809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:51.153386 7809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:51.154577 7809 hybrid_clock.cc:648] HybridClock initialized: now 1786372251154559 us; error 36 us; skew 500 ppm
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:51.157811 7809 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:30:51.158737 7809 webserver.cc:460] Webserver started at http://127.1.206.126:42039/ using document root <none> and password file <none>
I20260810 14:30:51.159272 7809 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:51.159334 7809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:51.159503 7809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:51.161615 7809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "b7f68e5ccfb6451daef01e45293c8521"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "5b7fbc645ff77010469906755c57c4b8"
server_key_iv: "8cd16e08855ad500e9a827572f18eb62"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.162170 7809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "b7f68e5ccfb6451daef01e45293c8521"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "5b7fbc645ff77010469906755c57c4b8"
server_key_iv: "8cd16e08855ad500e9a827572f18eb62"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.166051 7809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:51.168593 7824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.169828 7809 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:30:51.169934 7809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "b7f68e5ccfb6451daef01e45293c8521"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "5b7fbc645ff77010469906755c57c4b8"
server_key_iv: "8cd16e08855ad500e9a827572f18eb62"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.170025 7809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:51.200234 7809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:51.203608 7809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:51.203781 7809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:51.211465 7809 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:42917
I20260810 14:30:51.211483 7878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:42917 every 8 connection(s)
I20260810 14:30:51.212486 7809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:51.215323 7880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:51.216598 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7809
I20260810 14:30:51.216737 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:51.217018 1849 external_mini_cluster.cc:1428] Setting key 7155964e75dd5a3a6cb32c5f767dee92
I20260810 14:30:51.222224 7880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521: Bootstrap starting.
I20260810 14:30:51.225008 7880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:51.225744 7880 log.cc:824] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372250, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:51.227937 7880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521: No bootstrap required, opened a new log
I20260810 14:30:51.231393 7880 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f68e5ccfb6451daef01e45293c8521" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42917 } }
I20260810 14:30:51.231640 7880 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:51.231698 7880 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7f68e5ccfb6451daef01e45293c8521, State: Initialized, Role: FOLLOWER
I20260810 14:30:51.232158 7880 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f68e5ccfb6451daef01e45293c8521" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42917 } }
I20260810 14:30:51.232332 7880 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:51.232426 7880 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:51.232539 7880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:51.232939 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:51.218501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36182 (local address 127.1.206.126:42917)
0810 14:30:51.218939 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:51.218958 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:51.219001 (+ 43us) server_negotiation.cc:407] Connection header received
0810 14:30:51.219862 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:51.219888 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:51.220343 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:51.220707 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:51.221422 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.222961 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.223871 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.224599 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.224758 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:51.227685 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:51.227689 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:51.227703 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:51.227730 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:51.229735 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.230244 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.230249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.230253 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.230378 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.230678 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.230682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.230684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.231082 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:51.231362 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:51.231653 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 14:30:51.231975 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":103,"threads_started":1}
I20260810 14:30:51.233549 7880 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f68e5ccfb6451daef01e45293c8521" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42917 } }
I20260810 14:30:51.233901 7880 leader_election.cc:302] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7f68e5ccfb6451daef01e45293c8521; no voters:
I20260810 14:30:51.234258 7880 leader_election.cc:288] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:51.234382 7885 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:51.234638 7885 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [term 1 LEADER]: Becoming Leader. State: Replica: b7f68e5ccfb6451daef01e45293c8521, State: Running, Role: LEADER
I20260810 14:30:51.234952 7885 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f68e5ccfb6451daef01e45293c8521" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42917 } }
I20260810 14:30:51.235471 7880 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:51.236127 7885 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7f68e5ccfb6451daef01e45293c8521. Latest consensus state: current_term: 1 leader_uuid: "b7f68e5ccfb6451daef01e45293c8521" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f68e5ccfb6451daef01e45293c8521" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42917 } } }
I20260810 14:30:51.236246 7885 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:51.236682 7892 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:51.236682 7887 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7f68e5ccfb6451daef01e45293c8521" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f68e5ccfb6451daef01e45293c8521" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42917 } } }
I20260810 14:30:51.236806 7887 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521 [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:51.239677 7892 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:51.245628 7892 catalog_manager.cc:1347] Generated new cluster ID: e0dc547019b24c8284533c440a3df0c4
I20260810 14:30:51.245733 7892 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:51.263015 7892 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:51.264070 7892 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:51.280601 7892 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7f68e5ccfb6451daef01e45293c8521: Generated new TSK 0
I20260810 14:30:51.281495 7892 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:30:51.319905 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42917
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:51.438412 7906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:51.438727 7906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:51.438804 7906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:51.443274 7906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:51.443382 7906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:51.443487 7906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:51.449158 7906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:51.450325 7906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:51.451392 7906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:51.461165 7911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.461133 7912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.461128 7914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:51.461393 7906 server_base.cc:1034] running on GCE node
I20260810 14:30:51.462061 7906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:51.462759 7906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:51.463932 7906 hybrid_clock.cc:648] HybridClock initialized: now 1786372251463912 us; error 30 us; skew 500 ppm
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:51.467871 7906 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:30:51.468839 7906 webserver.cc:460] Webserver started at http://127.1.206.65:36505/ using document root <none> and password file <none>
I20260810 14:30:51.469419 7906 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:51.469513 7906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:51.469748 7906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:51.471823 7906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "833132eaf7d54bb289ca94d348d2c34b"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "1d78ae6c8a42bd9bf8485bed8b505458"
server_key_iv: "27c51a73fccdcd4ba1d0fa67053b8b9a"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.472442 7906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "833132eaf7d54bb289ca94d348d2c34b"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "1d78ae6c8a42bd9bf8485bed8b505458"
server_key_iv: "27c51a73fccdcd4ba1d0fa67053b8b9a"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.476409 7906 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:30:51.478974 7922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.480167 7906 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:51.480340 7906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "833132eaf7d54bb289ca94d348d2c34b"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "1d78ae6c8a42bd9bf8485bed8b505458"
server_key_iv: "27c51a73fccdcd4ba1d0fa67053b8b9a"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.480471 7906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:51.497159 7906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:51.500603 7906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:51.500823 7906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:51.501420 7906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:51.502264 7906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:51.502338 7906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.502408 7906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:51.502453 7906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.511559 7906 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:40979
I20260810 14:30:51.511581 8041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:40979 every 8 connection(s)
I20260810 14:30:51.512578 7906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:51.517737 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 7906
I20260810 14:30:51.517887 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:51.518193 1849 external_mini_cluster.cc:1428] Setting key 37528446a06897b1d26271c7a17a7e72
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:51.528142 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:51.514371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:52571 (local address 127.1.206.126:42917)
0810 14:30:51.514499 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:51.514502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:51.515294 (+ 792us) server_negotiation.cc:407] Connection header received
0810 14:30:51.516805 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:51.516813 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:51.516888 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:51.516957 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:51.518497 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.519244 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.521076 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.521312 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.521403 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:51.524316 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:51.524320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:51.524322 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:51.524350 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:51.525926 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.526520 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.526523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.526525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.526610 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.526968 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.526972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.526974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.527170 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:51.527281 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:51.527818 (+ 537us) server_negotiation.cc:299] Negotiation successful
0810 14:30:51.527964 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:30:51.529091 8045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:51.514689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42917 (local address 127.1.206.65:52571)
0810 14:30:51.515127 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:51.515172 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:51.516589 (+ 1417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:51.517124 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:51.517131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:51.517587 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:51.518319 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:51.518350 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.519402 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.519405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:51.520938 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:51.520956 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.521488 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.521495 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:51.521775 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:51.522563 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:51.522580 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:51.524078 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:51.526071 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:51.526078 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:51.526105 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:51.526407 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:51.526705 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:51.526708 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:51.526710 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:51.526866 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:51.527292 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:51.527301 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:51.527564 (+ 263us) client_negotiation.cc:769] Sending connection context
0810 14:30:51.527766 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 14:30:51.528124 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":119,"threads_started":1}
I20260810 14:30:51.530516 8042 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42917
I20260810 14:30:51.530814 8042 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:30:51.531512 8042 heartbeater.cc:511] Master 127.1.206.126:42917 requested a full tablet report, sending...
I20260810 14:30:51.533439 7841 ts_manager.cc:194] Registered new tserver with Master: 833132eaf7d54bb289ca94d348d2c34b (127.1.206.65:40979)
I20260810 14:30:51.534765 7841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:52571
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:30:51.548789 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42917
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:51.663194 8048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:51.663549 8048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:51.663627 8048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:51.667958 8048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:51.668093 8048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:51.668196 8048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:51.673986 8048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:51.675179 8048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:51.676227 8048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:30:51.686280 8048 server_base.cc:1034] running on GCE node
W20260810 14:30:51.686221 8054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.686218 8056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.686249 8053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:51.686971 8048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:51.687682 8048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:51.688872 8048 hybrid_clock.cc:648] HybridClock initialized: now 1786372251688855 us; error 34 us; skew 500 ppm
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:51.691680 8048 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:30:51.692682 8048 webserver.cc:460] Webserver started at http://127.1.206.66:34273/ using document root <none> and password file <none>
I20260810 14:30:51.693296 8048 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:51.693409 8048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:51.693646 8048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:51.695705 8048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "5ec54bfa809944f68b5c9bc6c9d3f185"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "e056beb51076da0e2840815afd024895"
server_key_iv: "dbd5f126f268d429c29b505c248af2a2"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.696337 8048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "5ec54bfa809944f68b5c9bc6c9d3f185"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "e056beb51076da0e2840815afd024895"
server_key_iv: "dbd5f126f268d429c29b505c248af2a2"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.700034 8048 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:51.702531 8063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.703804 8048 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:51.703935 8048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "5ec54bfa809944f68b5c9bc6c9d3f185"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "e056beb51076da0e2840815afd024895"
server_key_iv: "dbd5f126f268d429c29b505c248af2a2"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.704052 8048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:51.724011 8048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:51.727371 8048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:51.727586 8048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:51.728197 8048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:51.729067 8048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:51.729115 8048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.729163 8048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:51.729179 8048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.738399 8048 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:42557
I20260810 14:30:51.738457 8180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:42557 every 8 connection(s)
I20260810 14:30:51.739352 8048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:51.746332 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 8048
I20260810 14:30:51.746474 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:51.746791 1849 external_mini_cluster.cc:1428] Setting key ca7c949f3a5cf024026aab70d72862bf
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:51.754703 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:51.741382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:57303 (local address 127.1.206.126:42917)
0810 14:30:51.741521 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:51.741525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:51.742487 (+ 962us) server_negotiation.cc:407] Connection header received
0810 14:30:51.743996 (+ 1509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:51.744000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:51.744062 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:51.744142 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:51.745401 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.745947 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.747262 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.747517 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.747629 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:51.750641 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:51.750644 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:51.750646 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:51.750673 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:51.752138 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.752865 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.752868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.752869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.752952 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.753380 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.753382 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.753383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.753570 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:51.753644 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:51.754457 (+ 813us) server_negotiation.cc:299] Negotiation successful
0810 14:30:51.754574 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 14:30:51.755972 8183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:51.741827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42917 (local address 127.1.206.66:57303)
0810 14:30:51.742329 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:51.742376 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:51.743771 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:51.744377 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:51.744385 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:51.744744 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:51.745240 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:51.745254 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.746083 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.746095 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:51.747137 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:51.747147 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.747729 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.747735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:51.747966 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:51.748773 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:51.748790 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:51.750449 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:51.752293 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:51.752304 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:51.752326 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:51.752744 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:51.753049 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:51.753055 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:51.753058 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:51.753279 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:51.753680 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:51.753689 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:51.754099 (+ 410us) client_negotiation.cc:769] Sending connection context
0810 14:30:51.754361 (+ 262us) client_negotiation.cc:240] Negotiation successful
0810 14:30:51.754784 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":127,"threads_started":1}
I20260810 14:30:51.757332 8181 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42917
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:51.757628 8181 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:51.758152 8181 heartbeater.cc:511] Master 127.1.206.126:42917 requested a full tablet report, sending...
I20260810 14:30:51.759267 7841 ts_manager.cc:194] Registered new tserver with Master: 5ec54bfa809944f68b5c9bc6c9d3f185 (127.1.206.66:42557)
I20260810 14:30:51.759895 7841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:57303
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:30:51.779033 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42917
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:51.896833 8186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:51.897126 8186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:51.897198 8186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:51.901433 8186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:51.901513 8186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:51.901607 8186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:51.907351 8186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42917
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:51.908627 8186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:51.909711 8186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:51.920367 8193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.920392 8192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:51.920387 8195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:51.920804 8186 server_base.cc:1034] running on GCE node
I20260810 14:30:51.921311 8186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:51.922079 8186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:51.923306 8186 hybrid_clock.cc:648] HybridClock initialized: now 1786372251923278 us; error 42 us; skew 500 ppm
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:51.926563 8186 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:30:51.927604 8186 webserver.cc:460] Webserver started at http://127.1.206.67:46417/ using document root <none> and password file <none>
I20260810 14:30:51.928293 8186 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:51.928402 8186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:51.928658 8186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:51.930846 8186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "ee60e12f189841e1a2e53ca832ed8acd"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "d2df13c1c7e411a95260a27b46fa65e0"
server_key_iv: "93ef9eecdd752f44b3088c6440bb03af"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.931449 8186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "ee60e12f189841e1a2e53ca832ed8acd"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "d2df13c1c7e411a95260a27b46fa65e0"
server_key_iv: "93ef9eecdd752f44b3088c6440bb03af"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.935725 8186 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:51.938555 8202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.939867 8186 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:51.940030 8186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "ee60e12f189841e1a2e53ca832ed8acd"
format_stamp: "Formatted at 2026-08-10 14:30:51 on dist-test-slave-0b58"
server_key: "d2df13c1c7e411a95260a27b46fa65e0"
server_key_iv: "93ef9eecdd752f44b3088c6440bb03af"
server_key_version: "encryptionkey@0"
I20260810 14:30:51.940184 8186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:51.963255 8186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:51.966951 8186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:51.967175 8186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:51.967823 8186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:51.968742 8186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:51.968813 8186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.968883 8186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:51.968922 8186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:51.978657 8186 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:33407
I20260810 14:30:51.978713 8325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:33407 every 8 connection(s)
I20260810 14:30:51.979717 8186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:51.987402 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 8186
I20260810 14:30:51.987550 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:51.987818 1849 external_mini_cluster.cc:1428] Setting key f8f539ebedce3b83784a88516cd04fca
Aug 10 14:30:51 dist-test-slave-0b58 krb5kdc[7795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372251, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:30:51.994830 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:51.982240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:32937 (local address 127.1.206.126:42917)
0810 14:30:51.982403 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:51.982408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:51.983310 (+ 902us) server_negotiation.cc:407] Connection header received
0810 14:30:51.984772 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:51.984776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:51.984828 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:51.984913 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:51.986158 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.986741 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.988023 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.988415 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.988529 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:51.991344 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:51.991348 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:51.991350 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:51.991378 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:51.992735 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.993227 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.993230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.993231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.993321 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:51.993688 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:51.993690 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:51.993692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:51.993895 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:51.994010 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:51.994559 (+ 549us) server_negotiation.cc:299] Negotiation successful
0810 14:30:51.994686 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:30:51.995661 8328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:51.982684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42917 (local address 127.1.206.67:32937)
0810 14:30:51.983150 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:51.983196 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:51.984538 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:51.985090 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:51.985096 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:51.985498 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:51.985991 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:51.986005 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.986858 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.986860 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:51.987890 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:51.987901 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:51.988589 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:51.988592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:51.988848 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:51.989526 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:51.989543 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:51.991164 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:51.992853 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:51.992858 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:51.992872 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:51.993141 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:51.993401 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:51.993403 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:51.993404 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:51.993614 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:51.994025 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:51.994038 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:51.994298 (+ 260us) client_negotiation.cc:769] Sending connection context
0810 14:30:51.994465 (+ 167us) client_negotiation.cc:240] Negotiation successful
0810 14:30:51.994732 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":122,"threads_started":1}
I20260810 14:30:51.996940 8326 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42917
I20260810 14:30:51.997188 8326 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:51.997690 8326 heartbeater.cc:511] Master 127.1.206.126:42917 requested a full tablet report, sending...
I20260810 14:30:51.998775 7841 ts_manager.cc:194] Registered new tserver with Master: ee60e12f189841e1a2e53ca832ed8acd (127.1.206.67:33407)
I20260810 14:30:51.999413 7841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:32937
I20260810 14:30:52.001834 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/test-admin.keytab.
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:52.018975 1849 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 14:30:52.021839 8334 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:52.020407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33834 (local address 127.1.206.65:40979)
0810 14:30:52.020714 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:52.020730 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:52.020755 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:30:52.020815 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:52.020820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:52.021003 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:52.021124 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:52.021627 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33834: BlockingRecv error: recv got EOF from 127.0.0.1:33834 (error 108)
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":106,"threads_started":1}
W20260810 14:30:52.021854 1849 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5cc' of type FILE
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:52.023074 1849 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:52.023993 1849 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:52.034389 8334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:52.024965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.1.206.65:40979)
0810 14:30:52.025101 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:52.025105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:52.025217 (+ 112us) server_negotiation.cc:407] Connection header received
0810 14:30:52.025395 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:52.025398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:52.025442 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:52.025524 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:52.026078 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:52.026892 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:52.027734 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:52.028132 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:52.028250 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:52.030566 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:52.030577 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:52.030590 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:52.030615 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:52.032514 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:52.033006 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:52.033012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:52.033013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:52.033094 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:52.033375 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:52.033379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:52.033381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:52.033650 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:52.033882 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:52.034084 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 14:30:52.034246 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260810 14:30:52.038436 8334 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:52.037343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33850 (local address 127.1.206.65:40979)
0810 14:30:52.037461 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:52.037465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:52.037616 (+ 151us) server_negotiation.cc:407] Connection header received
0810 14:30:52.037756 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:52.037759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:52.037806 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:52.037886 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:52.038323 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33850: BlockingRecv error: recv got EOF from 127.0.0.1:33850 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 14:30:52.038594 1849 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5cc' of type FILE
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:52.039690 1849 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:52.040695 1849 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:52.049584 8334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:52.041645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33866 (local address 127.1.206.65:40979)
0810 14:30:52.041762 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:52.041767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:52.041892 (+ 125us) server_negotiation.cc:407] Connection header received
0810 14:30:52.041990 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:52.041992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:52.042027 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:52.042090 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:52.042540 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:52.043029 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:52.043863 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:52.044140 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:52.044242 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:52.046670 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:52.046674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:52.046676 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:52.046699 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:52.047958 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:52.048426 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:52.048429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:52.048430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:52.048507 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:52.048803 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:52.048805 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:52.048806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:52.048967 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:52.049066 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:52.049255 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 14:30:52.049371 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260810 14:30:52.052784 8334 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:30:52.051573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33876 (local address 127.1.206.65:40979)
0810 14:30:52.051786 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:52.051789 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:52.051841 (+ 52us) server_negotiation.cc:407] Connection header received
0810 14:30:52.051959 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:52.051962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:52.051999 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:52.052060 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:52.052691 (+ 631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33876: BlockingRecv error: recv got EOF from 127.0.0.1:33876 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
W20260810 14:30:52.052897 1849 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786372219863018-1849-0/krb5kdc/krb5cc' of type FILE
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:52.054095 1849 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:52.055146 1849 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[7795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:30:52.064828 8334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:52.056292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33878 (local address 127.1.206.65:40979)
0810 14:30:52.056441 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:52.056445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:52.056461 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:30:52.056549 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:52.056552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:52.056589 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:52.056666 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:52.057226 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:52.057802 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:52.058686 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:52.058913 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:52.059003 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:52.061489 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:52.061493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:52.061495 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:52.061525 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:52.063059 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:52.063525 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:52.063529 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:52.063530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:52.063614 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:52.063902 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:52.063906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:52.063908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:52.064088 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:52.064246 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:52.064522 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 14:30:52.064651 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 14:30:52.065970 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7906
I20260810 14:30:52.074651 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 8048
I20260810 14:30:52.087184 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 8186
I20260810 14:30:52.097383 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 7809
2026-08-10T14:30:52Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2326 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[8350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[8350](info): set up 2 sockets
Aug 10 14:30:52 dist-test-slave-0b58 krb5kdc[8350](info): commencing operation
krb5kdc: starting...
W20260810 14:30:53.191196 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:30:53 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:30:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:30:53Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab.
Entry for principal oryx/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab.
I20260810 14:30:53.319571 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:42745
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab
--principal=oryx/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:42745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:53.432060 8365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:53.432420 8365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:53.432508 8365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:53.436579 8365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:53.436677 8365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:53.436717 8365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:53.436755 8365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:53.436786 8365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:53.442283 8365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:42745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab
--principal=oryx/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:42745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:53.443413 8365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:53.444497 8365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:53.452986 8371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:53.453092 8365 server_base.cc:1034] running on GCE node
W20260810 14:30:53.453002 8373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:53.453011 8370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:53.453958 8365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:53.455044 8365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:53.456209 8365 hybrid_clock.cc:648] HybridClock initialized: now 1786372253456189 us; error 35 us; skew 500 ppm
Aug 10 14:30:53 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:53.459164 8365 init.cc:377] Logged in from keytab as oryx/127.1.206.126@KRBTEST.COM (short username oryx)
I20260810 14:30:53.460106 8365 webserver.cc:460] Webserver started at http://127.1.206.126:37587/ using document root <none> and password file <none>
I20260810 14:30:53.460718 8365 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:53.460819 8365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:53.461051 8365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:53.463234 8365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "6865eb4902d14415af48b506b0db0cca"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "3a4e379b0295caac5e246d40433e23ac"
server_key_iv: "b23d036820d462348431566b1d09d8c9"
server_key_version: "encryptionkey@0"
I20260810 14:30:53.463835 8365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "6865eb4902d14415af48b506b0db0cca"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "3a4e379b0295caac5e246d40433e23ac"
server_key_iv: "b23d036820d462348431566b1d09d8c9"
server_key_version: "encryptionkey@0"
I20260810 14:30:53.467628 8365 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:30:53.470042 8381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:53.471304 8365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 14:30:53.471462 8365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "6865eb4902d14415af48b506b0db0cca"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "3a4e379b0295caac5e246d40433e23ac"
server_key_iv: "b23d036820d462348431566b1d09d8c9"
server_key_version: "encryptionkey@0"
I20260810 14:30:53.471601 8365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:53.488061 8365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:53.491539 8365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:53.491757 8365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:53.499341 8365 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:42745
I20260810 14:30:53.499637 8437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:42745 every 8 connection(s)
I20260810 14:30:53.500377 8365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:30:53.503239 8438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:53.506732 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 8365
I20260810 14:30:53.506899 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:30:53.507187 1849 external_mini_cluster.cc:1428] Setting key 10641db128bfe086740e476a69140986
I20260810 14:30:53.509721 8438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: Bootstrap starting.
I20260810 14:30:53.512732 8438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:53.513648 8438 log.cc:824] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:53.515570 8438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: No bootstrap required, opened a new log
Aug 10 14:30:53 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:30:53.519133 8438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } }
I20260810 14:30:53.519418 8438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:53.519505 8438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6865eb4902d14415af48b506b0db0cca, State: Initialized, Role: FOLLOWER
I20260810 14:30:53.519953 8438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } }
I20260810 14:30:53.520105 8438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:30:53.520190 8438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:30:53.520328 8438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:53.521270 8438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } }
I20260810 14:30:53.521641 8438 leader_election.cc:302] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6865eb4902d14415af48b506b0db0cca; no voters:
I20260810 14:30:53.521986 8438 leader_election.cc:288] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:30:53.522114 8443 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:53.522316 8443 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 1 LEADER]: Becoming Leader. State: Replica: 6865eb4902d14415af48b506b0db0cca, State: Running, Role: LEADER
I20260810 14:30:53.522686 8443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } }
I20260810 14:30:53.523350 8438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:53.523646 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:53.508687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47924 (local address 127.1.206.126:42745)
0810 14:30:53.509153 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:53.509173 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:53.509219 (+ 46us) server_negotiation.cc:407] Connection header received
0810 14:30:53.510118 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:53.510145 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:53.510638 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:53.511082 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:53.511833 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:53.513420 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:53.514360 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:53.514843 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:53.515028 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:53.517872 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:53.517877 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:53.517891 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:53.517919 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:53.520499 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:53.520975 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:53.520981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:53.520987 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:53.521119 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:53.521419 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:53.521423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:53.521425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:53.521921 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:53.522120 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:53.522513 (+ 393us) server_negotiation.cc:299] Negotiation successful
0810 14:30:53.522822 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":123,"threads_started":1}
I20260810 14:30:53.523916 8443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6865eb4902d14415af48b506b0db0cca. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } }
I20260810 14:30:53.524048 8443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:53.524499 8448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:53.525978 8444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } }
I20260810 14:30:53.526105 8444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:53.528012 8448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:53.534492 8448 catalog_manager.cc:1347] Generated new cluster ID: eacd69e3ba5b4b7986c347ed9c29c021
I20260810 14:30:53.534584 8448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:53.559999 8448 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:30:53.561223 8448 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:53.570201 8448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: Generated new TSK 0
I20260810 14:30:53.570971 8448 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab.
Entry for principal oryx/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab.
I20260810 14:30:53.611848 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42745
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab
--principal=oryx/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:53.736902 8464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:53.737228 8464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:53.737326 8464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:53.741547 8464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:53.741639 8464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:53.741730 8464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:53.747431 8464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab
--principal=oryx/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:53.748574 8464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:53.749687 8464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:53.759598 8473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:53.759831 8464 server_base.cc:1034] running on GCE node
W20260810 14:30:53.759675 8471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:53.759615 8470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:53.760380 8464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:53.761077 8464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:53.762291 8464 hybrid_clock.cc:648] HybridClock initialized: now 1786372253762277 us; error 41 us; skew 500 ppm
Aug 10 14:30:53 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:53.765185 8464 init.cc:377] Logged in from keytab as oryx/127.1.206.65@KRBTEST.COM (short username oryx)
I20260810 14:30:53.766119 8464 webserver.cc:460] Webserver started at http://127.1.206.65:33413/ using document root <none> and password file <none>
I20260810 14:30:53.766703 8464 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:53.766798 8464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:53.767032 8464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:53.769176 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "aee658ee993e4a71974d24e1019870ec"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "eb8f98cad3dd5e1088737f5cf3598307"
server_key_iv: "49452c0f5b0f3138c3697a0d49bffcea"
server_key_version: "encryptionkey@0"
I20260810 14:30:53.769812 8464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "aee658ee993e4a71974d24e1019870ec"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "eb8f98cad3dd5e1088737f5cf3598307"
server_key_iv: "49452c0f5b0f3138c3697a0d49bffcea"
server_key_version: "encryptionkey@0"
I20260810 14:30:53.773694 8464 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:30:53.776332 8481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:53.777667 8464 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:30:53.777820 8464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "aee658ee993e4a71974d24e1019870ec"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "eb8f98cad3dd5e1088737f5cf3598307"
server_key_iv: "49452c0f5b0f3138c3697a0d49bffcea"
server_key_version: "encryptionkey@0"
I20260810 14:30:53.777942 8464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:53.797657 8464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:53.801326 8464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:53.801569 8464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:53.802222 8464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:53.803122 8464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:53.803170 8464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:53.803238 8464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:53.803268 8464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:53.812237 8464 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:37967
I20260810 14:30:53.812364 8601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:37967 every 8 connection(s)
I20260810 14:30:53.813290 8464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:53.820799 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 8464
I20260810 14:30:53.820935 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:30:53.821223 1849 external_mini_cluster.cc:1428] Setting key c1a5b2e0f9f7743aa2595576d973a92d
Aug 10 14:30:53 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:30:53.828992 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:53.815343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:60785 (local address 127.1.206.126:42745)
0810 14:30:53.815486 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:53.815490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:53.816468 (+ 978us) server_negotiation.cc:407] Connection header received
0810 14:30:53.817883 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:53.817886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:53.817949 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:53.818054 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:53.819260 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:53.819809 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:53.821118 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:53.821395 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:53.821507 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:53.824549 (+ 3042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:53.824552 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:53.824554 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:53.824580 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:53.826466 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:53.827021 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:53.827028 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:53.827032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:53.827133 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:53.827467 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:53.827473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:53.827477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:53.827780 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:53.827895 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:53.828589 (+ 694us) server_negotiation.cc:299] Negotiation successful
0810 14:30:53.828753 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:30:53.829703 8604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:53.815756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:60785)
0810 14:30:53.816309 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:53.816364 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:53.817662 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:53.818235 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:53.818242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:53.818628 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:53.819108 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:53.819121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:53.819941 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:53.819944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:53.820973 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:53.820989 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:53.821555 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:53.821559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:53.821740 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:53.822360 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:53.822377 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:53.824354 (+ 1977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:53.826596 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:53.826603 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:53.826617 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:53.826904 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:53.827227 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:53.827230 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:53.827231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:53.827366 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:53.827898 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:53.827903 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:53.828243 (+ 340us) client_negotiation.cc:769] Sending connection context
0810 14:30:53.828478 (+ 235us) client_negotiation.cc:240] Negotiation successful
0810 14:30:53.828765 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":144,"threads_started":1}
I20260810 14:30:53.831023 8602 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42745
I20260810 14:30:53.831314 8602 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:53.831985 8602 heartbeater.cc:511] Master 127.1.206.126:42745 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:30:53.833737 8400 ts_manager.cc:194] Registered new tserver with Master: aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967)
I20260810 14:30:53.834923 8400 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:60785
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab.
Entry for principal oryx/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab.
I20260810 14:30:53.851325 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42745
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab
--principal=oryx/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:53.965516 8607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:53.965839 8607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:53.965921 8607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:53.970440 8607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:53.970517 8607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:53.970618 8607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:53.976075 8607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab
--principal=oryx/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:53.977265 8607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:53.978385 8607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:53.988399 8614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:53.988438 8616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:53.988399 8613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:53.988803 8607 server_base.cc:1034] running on GCE node
I20260810 14:30:53.989166 8607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:53.989807 8607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:53.990979 8607 hybrid_clock.cc:648] HybridClock initialized: now 1786372253990944 us; error 46 us; skew 500 ppm
Aug 10 14:30:53 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:53.993814 8607 init.cc:377] Logged in from keytab as oryx/127.1.206.66@KRBTEST.COM (short username oryx)
I20260810 14:30:53.994798 8607 webserver.cc:460] Webserver started at http://127.1.206.66:38791/ using document root <none> and password file <none>
I20260810 14:30:53.995345 8607 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:53.995407 8607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:53.995577 8607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:53.997634 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "873b06cd53ae48828d8236de5b817e87"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "292ae45aae242403933b84f8e97b5bea"
server_key_iv: "8faf30300972653a5761bdb9c5803f20"
server_key_version: "encryptionkey@0"
I20260810 14:30:53.998292 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "873b06cd53ae48828d8236de5b817e87"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "292ae45aae242403933b84f8e97b5bea"
server_key_iv: "8faf30300972653a5761bdb9c5803f20"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.002276 8607 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:54.004786 8623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.006150 8607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:54.006314 8607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "873b06cd53ae48828d8236de5b817e87"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "292ae45aae242403933b84f8e97b5bea"
server_key_iv: "8faf30300972653a5761bdb9c5803f20"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.006438 8607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:54.020363 8607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:54.023898 8607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:54.024117 8607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:54.024866 8607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:54.025771 8607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:54.025820 8607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.025859 8607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:54.025880 8607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.035429 8607 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:35473
I20260810 14:30:54.035451 8743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:35473 every 8 connection(s)
I20260810 14:30:54.036414 8607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:54.038858 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 8607
I20260810 14:30:54.038995 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:30:54.039302 1849 external_mini_cluster.cc:1428] Setting key 0300ce70840e0e29b911aed2c35171c0
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:30:54.052183 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.038399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:44067 (local address 127.1.206.126:42745)
0810 14:30:54.038574 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.038580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.039559 (+ 979us) server_negotiation.cc:407] Connection header received
0810 14:30:54.041204 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.041208 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.041269 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.041369 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.042578 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.043251 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.044748 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.044974 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.045058 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.048078 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.048081 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.048083 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.048109 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.049715 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.050414 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.050418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.050425 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.050511 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.050890 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.050894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.050896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.051108 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.051220 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.051853 (+ 633us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.052004 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.67@KRBTEST.COM" created.
I20260810 14:30:54.053176 8746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.038820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:44067)
0810 14:30:54.039379 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.039436 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.040986 (+ 1550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.041529 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.041536 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.041918 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.042427 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.042440 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.043389 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.043394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.044642 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.044652 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.045132 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.045139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.045383 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.046048 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.046074 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.047884 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.049886 (+ 2002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.049893 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.049913 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.050282 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.050606 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.050610 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.050611 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.050779 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.051221 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.051231 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.051549 (+ 318us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.051791 (+ 242us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.052167 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":171,"threads_started":1}
I20260810 14:30:54.054440 8744 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42745
I20260810 14:30:54.054692 8744 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:54.055317 8744 heartbeater.cc:511] Master 127.1.206.126:42745 requested a full tablet report, sending...
I20260810 14:30:54.056566 8400 ts_manager.cc:194] Registered new tserver with Master: 873b06cd53ae48828d8236de5b817e87 (127.1.206.66:35473)
I20260810 14:30:54.057170 8400 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:44067
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab.
Entry for principal oryx/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab.
I20260810 14:30:54.070711 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42745
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab
--principal=oryx/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:54.187160 8749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:54.187461 8749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:54.187533 8749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:54.191666 8749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:54.191745 8749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:54.191807 8749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:54.197346 8749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab
--principal=oryx/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:42745
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:54.198606 8749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:54.199674 8749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:54.209542 8755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:54.209532 8754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:54.209718 8749 server_base.cc:1034] running on GCE node
W20260810 14:30:54.209529 8757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:54.210243 8749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:54.210893 8749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:54.212051 8749 hybrid_clock.cc:648] HybridClock initialized: now 1786372254212010 us; error 57 us; skew 500 ppm
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:54.214892 8749 init.cc:377] Logged in from keytab as oryx/127.1.206.67@KRBTEST.COM (short username oryx)
I20260810 14:30:54.215821 8749 webserver.cc:460] Webserver started at http://127.1.206.67:41839/ using document root <none> and password file <none>
I20260810 14:30:54.216540 8749 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:54.216645 8749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:54.216881 8749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:54.219077 8749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "9d601a9038fc4c7eac2903435704842a"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "a92555774cdc361331cf5c1ec1f766fd"
server_key_iv: "03ba446cd94a2454008c83a3d671407f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.219694 8749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "9d601a9038fc4c7eac2903435704842a"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "a92555774cdc361331cf5c1ec1f766fd"
server_key_iv: "03ba446cd94a2454008c83a3d671407f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.224421 8749 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 14:30:54.227926 8764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.229702 8749 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:54.229830 8749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "9d601a9038fc4c7eac2903435704842a"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "a92555774cdc361331cf5c1ec1f766fd"
server_key_iv: "03ba446cd94a2454008c83a3d671407f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.229955 8749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:54.249568 8749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:54.252636 8749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:54.252800 8749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:54.253345 8749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:54.254148 8749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:54.254195 8749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.254236 8749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:54.254257 8749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.263013 8749 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:37893
I20260810 14:30:54.263037 8887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:37893 every 8 connection(s)
I20260810 14:30:54.263945 8749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:54.268427 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 8749
I20260810 14:30:54.268559 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:30:54.268911 1849 external_mini_cluster.cc:1428] Setting key 830f7f5d66f61c391be57634ebdd4cd7
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:30:54.278789 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.266305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:39025 (local address 127.1.206.126:42745)
0810 14:30:54.266449 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.266452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.267264 (+ 812us) server_negotiation.cc:407] Connection header received
0810 14:30:54.269009 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.269013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.269077 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.269156 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.270568 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.271192 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.272404 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.272629 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.272750 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.275183 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.275187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.275194 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.275220 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.276745 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.277269 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.277273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.277275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.277357 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.277691 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.277695 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.277696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.277884 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.277987 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.278485 (+ 498us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.278615 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:30:54.279623 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.266659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:39025)
0810 14:30:54.267111 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.267154 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.268740 (+ 1586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.269362 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.269368 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.269801 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.270401 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.270416 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.271301 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.271304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.272204 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.272214 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.272789 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.272793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.272973 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.273578 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.273595 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.275019 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.276865 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.276871 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.276887 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.277180 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.277449 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.277453 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.277454 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.277593 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.277987 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.277995 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.278255 (+ 260us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.278445 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.278789 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":120,"threads_started":1}
I20260810 14:30:54.280843 8888 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42745
I20260810 14:30:54.281107 8888 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:54.281628 8888 heartbeater.cc:511] Master 127.1.206.126:42745 requested a full tablet report, sending...
I20260810 14:30:54.282809 8400 ts_manager.cc:194] Registered new tserver with Master: 9d601a9038fc4c7eac2903435704842a (127.1.206.67:37893)
I20260810 14:30:54.283428 8400 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:39025
I20260810 14:30:54.295089 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.206.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.125.keytab.
Entry for principal oryx/127.1.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.125.keytab.
I20260810 14:30:54.323634 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:44183
--webserver_interface=127.1.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.125.keytab
--principal=oryx/127.1.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:42745,127.1.206.125:44183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:30:54.440512 8895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:54.440816 8895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:54.440858 8895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:54.444950 8895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:54.445014 8895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:54.445034 8895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:54.445050 8895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:54.445066 8895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:54.450788 8895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:42745,127.1.206.125:44183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.125.keytab
--principal=oryx/127.1.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:44183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
W20260810 14:30:54.451007 8895 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.1.206.126:42745,127.1.206.125:44183'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 14:30:54.451905 8895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:54.452973 8895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:30:54.461805 8895 server_base.cc:1034] running on GCE node
W20260810 14:30:54.461736 8903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:54.461910 8901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:54.461777 8900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:54.462599 8895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:54.463758 8895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:54.464951 8895 hybrid_clock.cc:648] HybridClock initialized: now 1786372254464934 us; error 31 us; skew 500 ppm
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:54.472697 8895 init.cc:377] Logged in from keytab as oryx/127.1.206.125@KRBTEST.COM (short username oryx)
I20260810 14:30:54.473726 8895 webserver.cc:460] Webserver started at http://127.1.206.125:35643/ using document root <none> and password file <none>
I20260810 14:30:54.474284 8895 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:54.474354 8895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:54.474534 8895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:54.477442 8895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/instance:
uuid: "201a109babe647b591a4c45284a69c8b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "07b4d7ea6896e4752ad03204ca6cfc33"
server_key_iv: "18447b7dd9c6644e7b956679a263753f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.478209 8895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal/instance:
uuid: "201a109babe647b591a4c45284a69c8b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "07b4d7ea6896e4752ad03204ca6cfc33"
server_key_iv: "18447b7dd9c6644e7b956679a263753f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.482496 8895 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:54.485132 8911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.486430 8895 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:30:54.486583 8895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
uuid: "201a109babe647b591a4c45284a69c8b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "07b4d7ea6896e4752ad03204ca6cfc33"
server_key_iv: "18447b7dd9c6644e7b956679a263753f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.486706 8895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:54.509795 8895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:54.513377 8895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:54.513599 8895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:54.520958 8895 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.125:44183
I20260810 14:30:54.521267 8965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.125:44183 every 8 connection(s)
I20260810 14:30:54.522099 8895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
I20260810 14:30:54.525180 8966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:54.529178 8966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:30:54.531936 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 8895
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.125@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.206.125@KRBTEST.COM
I20260810 14:30:54.543629 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.531480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47936 (local address 127.1.206.126:42745)
0810 14:30:54.531638 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.531642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.532510 (+ 868us) server_negotiation.cc:407] Connection header received
0810 14:30:54.533791 (+ 1281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.533794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.533854 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.533939 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.534863 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.535390 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.536699 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.537036 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.537119 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.539764 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.539767 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.539769 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.539796 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.541457 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.541987 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.541991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.541993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.542083 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.542434 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.542438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.542439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.542679 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.542788 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.543327 (+ 539us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.543459 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 14:30:54.544621 8968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.531820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:47936)
0810 14:30:54.532342 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.532397 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.533517 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.533993 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.533998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.534435 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.534720 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.534732 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.535537 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.535540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.536585 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.536595 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.537191 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.537195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.537371 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.537996 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.538012 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.539600 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.541584 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.541595 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.541607 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.541882 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.542181 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.542184 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.542187 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.542337 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.542788 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.542796 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.543060 (+ 264us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.543281 (+ 221us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.543613 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"spinlock_wait_cycles":17664,"thread_start_us":144,"threads_started":1}
I20260810 14:30:54.544622 8970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.532850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33370 (local address 127.1.206.125:44183)
0810 14:30:54.533245 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.533258 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.533299 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:30:54.533517 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.533539 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.533814 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.533994 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.534721 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.535980 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.536921 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.537420 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.537562 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.540482 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.540488 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.540500 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.540522 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.542191 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.542712 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.542718 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.542719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.542799 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.543087 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.543091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.543093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.543337 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.543553 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.544049 (+ 496us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.544180 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":81,"threads_started":1}
I20260810 14:30:54.546880 8966 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.125@KRBTEST.COM for oryx/127.1.206.125@KRBTEST.COM
I20260810 14:30:54.554598 8968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.547412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.0.0.1:33376)
0810 14:30:54.547543 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.547559 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.547645 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.547866 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.547868 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.548031 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.548109 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.548114 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.548886 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.548889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.549395 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.549402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.549873 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.549877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.549979 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.550447 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.550466 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.551702 (+ 1236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.553236 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.553239 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.553240 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.553430 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.553821 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.553824 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.553825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.553901 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.554215 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.554217 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.554292 (+ 75us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.554374 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.554475 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 14:30:54.554675 8970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.547445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33376 (local address 127.1.206.125:44183)
0810 14:30:54.547543 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.547548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.547614 (+ 66us) server_negotiation.cc:407] Connection header received
0810 14:30:54.547741 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.547744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.547780 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.547855 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.548212 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.548763 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.549533 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.549766 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.549877 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.551832 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.551835 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.551837 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.551857 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.553133 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.553509 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.553511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.553513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.553583 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.553975 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.553977 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.553978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.554140 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.554212 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.554426 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.554538 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":35}
I20260810 14:30:54.558104 8966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Bootstrap starting.
I20260810 14:30:54.560599 8966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:54.561350 8966 log.cc:824] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:54.563254 8966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: No bootstrap required, opened a new log
I20260810 14:30:54.566385 8966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } }
I20260810 14:30:54.566619 8966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:54.566704 8966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201a109babe647b591a4c45284a69c8b, State: Initialized, Role: FOLLOWER
I20260810 14:30:54.567173 8966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } }
I20260810 14:30:54.567708 8972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } } }
I20260810 14:30:54.567842 8972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:30:54.568492 8966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: configured and running, proceeding with master startup.
W20260810 14:30:54.573220 8984 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:30:54.573326 8984 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:30:54.575423 8895 master_runner.cc:428] Detected that this master 201a109babe647b591a4c45284a69c8b is joining an existing cluster
I20260810 14:30:54.575492 8895 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.206.125:44183
I20260810 14:30:54.587502 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.578341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47944 (local address 127.1.206.126:42745)
0810 14:30:54.578480 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.578485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.578502 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:30:54.578597 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.578608 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.578669 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.578750 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.579338 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.579910 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.581209 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.581615 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.581728 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.583687 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.583692 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.583694 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.583724 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.585659 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.586175 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.586179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.586181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.586301 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.586568 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.586571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.586573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.586807 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.586916 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.587185 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.587322 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 14:30:54.587594 8970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.577977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33380 (local address 127.1.206.125:44183)
0810 14:30:54.578094 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.578099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.578656 (+ 557us) server_negotiation.cc:407] Connection header received
0810 14:30:54.578784 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.578787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.578820 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.578865 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.579377 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.580129 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.581246 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.581487 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.581603 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.583977 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.583981 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.583983 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.584007 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.585796 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.586317 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.586321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.586324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.586409 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.586648 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.586651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.586653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.586851 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.586939 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.587194 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.587453 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":151,"server-negotiator.queue_time_us":34}
I20260810 14:30:54.587601 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.578089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.0.0.1:33380)
0810 14:30:54.578573 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.578587 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.578684 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.578966 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.578968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.579173 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.579260 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.579288 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.580286 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.580290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.581149 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.581159 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.581767 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.581770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.581988 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.583483 (+ 1495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.583498 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.583853 (+ 355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.585905 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.585909 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.585911 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.586221 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.586484 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.586489 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.586491 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.586574 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.586973 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.586976 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.587049 (+ 73us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.587254 (+ 205us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.587398 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":120,"spinlock_wait_cycles":3456,"thread_start_us":86,"threads_started":1}
I20260810 14:30:54.588452 8992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.577955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:47944)
0810 14:30:54.578370 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.578387 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.578490 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.578776 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.578778 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.579050 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.579200 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.579208 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.580027 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.580032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.581072 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.581083 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.581779 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.581783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.581987 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.582874 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.582894 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.583516 (+ 622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.585798 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.585801 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.585803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.586066 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.586384 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.586386 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.586388 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.586487 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.586903 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.586907 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.587008 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.587127 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.587321 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":153,"spinlock_wait_cycles":10368,"thread_start_us":102,"threads_started":1}
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.126@KRBTEST.COM for oryx/127.1.206.125@KRBTEST.COM
I20260810 14:30:54.603024 8970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.593201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33388 (local address 127.1.206.125:44183)
0810 14:30:54.593338 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.593343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.593721 (+ 378us) server_negotiation.cc:407] Connection header received
0810 14:30:54.593895 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.593897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.593944 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.594011 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.594825 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.595300 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.596582 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.596791 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.596868 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.599439 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.599447 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.599449 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.599471 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.601169 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.601718 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.601722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.601724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.601815 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.602093 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.602097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.602099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.602285 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.602391 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.602728 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.602860 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:30:54.603036 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.593146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.0.0.1:33388)
0810 14:30:54.593574 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.593637 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.593776 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.594069 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.594075 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.594550 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.594702 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.594710 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.595406 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.595409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.596471 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.596483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.596901 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.596905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.597036 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.597554 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.597570 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.599307 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.601321 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.601331 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.601338 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.601607 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.601920 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.601923 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.601924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.602003 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.602396 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.602405 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.602526 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.602674 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.602879 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":110,"threads_started":1}
I20260810 14:30:54.604720 8400 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.206.125:44183: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "201a109babe647b591a4c45284a69c8b"
member_type: NON_VOTER
last_known_addr {
host: "127.1.206.125"
port: 44183
}
attrs {
promote: true
}
}
dest_uuid: "6865eb4902d14415af48b506b0db0cca"
cas_config_opid_index: -1
I20260810 14:30:54.605626 8400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } }
I20260810 14:30:54.608014 8996 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 201a109babe647b591a4c45284a69c8b (127.1.206.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } }
I20260810 14:30:54.609031 8939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 0 FOLLOWER]: Advancing to term 1
WARNING: no policy specified for oryx/127.1.206.124@KRBTEST.COM; defaulting to no policy
I20260810 14:30:54.610194 8996 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.206.125:44183
I20260810 14:30:54.610606 8939 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Refusing update from remote peer 6865eb4902d14415af48b506b0db0cca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 14:30:54.610818 8895 master.cc:537] Master@127.1.206.125:44183 shutting down...
I20260810 14:30:54.610736 8998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } }
I20260810 14:30:54.611344 8998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:54.611582 8998 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Connected to new peer: Peer: permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 14:30:54.613933 8385 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.124@KRBTEST.COM" created.
W20260810 14:30:54.615259 8385 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca -> Peer 201a109babe647b591a4c45284a69c8b (127.1.206.125:44183): Couldn't send request to peer 201a109babe647b591a4c45284a69c8b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 14:30:54.618374 8895 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:54.618750 8895 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:54.618911 8895 tablet_replica.cc:330] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: stopping tablet replica
I20260810 14:30:54.625056 8895 master.cc:552] Master@127.1.206.125:44183 shutdown complete.
I20260810 14:30:54.625121 8895 master_runner.cc:305] Clearing existing system tablet
I20260810 14:30:54.625389 8895 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:54.625449 8895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:54.626796 8895 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 14:30:54.628562 9003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.628788 8895 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:54.628937 8895 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:30:54.628981 8895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
uuid: "201a109babe647b591a4c45284a69c8b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "07b4d7ea6896e4752ad03204ca6cfc33"
server_key_iv: "18447b7dd9c6644e7b956679a263753f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.631541 8895 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Deleting tablet data with delete state TABLET_DATA_DELETED
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.124.keytab.
Entry for principal oryx/127.1.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.124.keytab.
I20260810 14:30:54.635076 8895 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 14:30:54.635207 8895 log.cc:1196] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 14:30:54.635522 8895 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Deleting consensus metadata
I20260810 14:30:54.635509 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:40121
--webserver_interface=127.1.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.124.keytab
--principal=oryx/127.1.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:30:54.635715 8895 master_runner.cc:315] Copying system tablet from 127.1.206.126:42745
I20260810 14:30:54.637378 8895 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: tablet copy: Beginning tablet copy session from remote peer at address 127.1.206.126:42745
I20260810 14:30:54.645650 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.638159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47960 (local address 127.1.206.126:42745)
0810 14:30:54.638306 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.638310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.638504 (+ 194us) server_negotiation.cc:407] Connection header received
0810 14:30:54.638672 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.638674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.638719 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.638813 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.639292 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.639838 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.640758 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.640990 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.641098 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.642353 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.642356 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.642358 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.642385 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.643864 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.644391 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.644395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.644397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.644481 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.644772 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.644776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.644778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.644972 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.645081 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.645369 (+ 288us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.645487 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:30:54.645665 9010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.638060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:47960)
0810 14:30:54.638406 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.638418 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.638555 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.638831 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.638833 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.639041 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.639164 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.639170 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.639955 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.639960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.640625 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.640635 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.641115 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.641119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.641216 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.641784 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.641803 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.642186 (+ 383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.643983 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.643987 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.643989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.644204 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.644576 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.644580 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.644582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.644675 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.645071 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.645074 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.645183 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.645307 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.645475 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":99,"threads_started":1}
I20260810 14:30:54.646291 8422 tablet_copy_service.cc:140] P 6865eb4902d14415af48b506b0db0cca: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 201a109babe647b591a4c45284a69c8b ({username='oryx', principal='oryx/127.1.206.125@KRBTEST.COM'} at 127.0.0.1:47960)
I20260810 14:30:54.646484 8422 tablet_copy_service.cc:161] P 6865eb4902d14415af48b506b0db0cca: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 201a109babe647b591a4c45284a69c8b at {username='oryx', principal='oryx/127.1.206.125@KRBTEST.COM'} at 127.0.0.1:47960: session id = 201a109babe647b591a4c45284a69c8b-00000000000000000000000000000000
I20260810 14:30:54.648063 8422 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 14:30:54.649837 8895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 14:30:54.652007 8895 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: tablet copy: Starting download of 0 data blocks...
I20260810 14:30:54.652240 8895 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: tablet copy: Starting download of 1 WAL segments...
I20260810 14:30:54.654043 8895 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 14:30:54.655709 8422 tablet_copy_service.cc:342] P 6865eb4902d14415af48b506b0db0cca: Request end of tablet copy session 201a109babe647b591a4c45284a69c8b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.206.125@KRBTEST.COM'} at 127.0.0.1:47960
I20260810 14:30:54.655848 8422 tablet_copy_service.cc:433] P 6865eb4902d14415af48b506b0db0cca: ending tablet copy session 201a109babe647b591a4c45284a69c8b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 201a109babe647b591a4c45284a69c8b
I20260810 14:30:54.663484 8895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:54.665186 9011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:54.665450 9014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:54.665472 8895 server_base.cc:1034] running on GCE node
W20260810 14:30:54.668445 9012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:54.668715 8895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:54.669060 8895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:54.670202 8895 hybrid_clock.cc:648] HybridClock initialized: now 1786372254670202 us; error 53 us; skew 500 ppm
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:54.671645 8895 init.cc:377] Logged in from keytab as oryx/127.1.206.125@KRBTEST.COM (short username oryx)
I20260810 14:30:54.672178 8895 webserver.cc:460] Webserver started at http://127.1.206.125:37479/ using document root <none> and password file <none>
I20260810 14:30:54.672418 8895 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:54.672472 8895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:54.673625 8895 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:54.674608 9021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.674852 8895 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:54.674938 8895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
uuid: "201a109babe647b591a4c45284a69c8b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "07b4d7ea6896e4752ad03204ca6cfc33"
server_key_iv: "18447b7dd9c6644e7b956679a263753f"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.675045 8895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:54.689029 8895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:54.691046 8895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:54.696314 8895 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.125:44183
I20260810 14:30:54.696578 9079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.125:44183 every 8 connection(s)
I20260810 14:30:54.696973 8895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
I20260810 14:30:54.698607 9080 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:30:54.699616 9080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Bootstrap starting.
I20260810 14:30:54.708297 9080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:30:54.708647 9080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: Bootstrap complete.
I20260810 14:30:54.709236 9080 raft_consensus.cc:348] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } }
I20260810 14:30:54.709383 9080 raft_consensus.cc:729] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 201a109babe647b591a4c45284a69c8b, State: Initialized, Role: LEARNER
I20260810 14:30:54.709503 9080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } }
I20260810 14:30:54.709929 9083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } }
I20260810 14:30:54.710098 9083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: LEARNER
I20260810 14:30:54.710114 9080 sys_catalog.cc:564] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:54.713150 9096 catalog_manager.cc:1259] Loaded cluster ID: eacd69e3ba5b4b7986c347ed9c29c021
I20260810 14:30:54.713276 9096 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: loading cluster ID for follower catalog manager: success
I20260810 14:30:54.715129 9096 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: acquiring CA information for follower catalog manager: success
I20260810 14:30:54.716380 9096 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 14:30:54.780082 9009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:54.780385 9009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:54.780426 9009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:54.785286 9009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:30:54.785382 9009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:54.785408 9009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:54.785427 9009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:30:54.785451 9009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:30:54.791415 9009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.124.keytab
--principal=oryx/127.1.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:40121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:54.792533 9009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:54.793582 9009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:54.802443 9102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:54.802425 9101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:54.802419 9104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:54.802780 9009 server_base.cc:1034] running on GCE node
I20260810 14:30:54.803402 9009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:54.804631 9009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:54.805837 9009 hybrid_clock.cc:648] HybridClock initialized: now 1786372254805822 us; error 36 us; skew 500 ppm
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:54.808729 9009 init.cc:377] Logged in from keytab as oryx/127.1.206.124@KRBTEST.COM (short username oryx)
I20260810 14:30:54.809639 9009 webserver.cc:460] Webserver started at http://127.1.206.124:42651/ using document root <none> and password file <none>
I20260810 14:30:54.810258 9009 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:54.810352 9009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:54.810586 9009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:30:54.813046 9009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/instance:
uuid: "7695f18d3531496b97bc02a78903868b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "597fe30905242077180439ed36dadd52"
server_key_iv: "2d1737b19aff4fab2ed9ab1b489aa954"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.813663 9009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal/instance:
uuid: "7695f18d3531496b97bc02a78903868b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "597fe30905242077180439ed36dadd52"
server_key_iv: "2d1737b19aff4fab2ed9ab1b489aa954"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.818081 9009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:30:54.820741 9111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:54.822090 9009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:54.822265 9009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
uuid: "7695f18d3531496b97bc02a78903868b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "597fe30905242077180439ed36dadd52"
server_key_iv: "2d1737b19aff4fab2ed9ab1b489aa954"
server_key_version: "encryptionkey@0"
I20260810 14:30:54.822399 9009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:54.837577 8602 heartbeater.cc:503] Master 127.1.206.126:42745 was elected leader, sending a full tablet report...
I20260810 14:30:54.863065 9009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:54.866284 9009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:54.866503 9009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:54.874390 9009 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.124:40121
I20260810 14:30:54.874715 9167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.124:40121 every 8 connection(s)
I20260810 14:30:54.875468 9009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
I20260810 14:30:54.876909 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 9009
I20260810 14:30:54.879107 9168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:54.883580 9168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.206.124@KRBTEST.COM
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.124@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:30:54.893571 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.878519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42200 (local address 127.1.206.124:40121)
0810 14:30:54.878987 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.879002 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.879039 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:30:54.879785 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.879803 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.880132 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.880480 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.881483 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.882664 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.883858 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.884480 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.884606 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.888052 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.888059 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.888071 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.888107 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.890196 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.890742 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.890747 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.890752 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.890884 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.891207 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.891210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.891211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.891727 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.891949 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.892207 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.892534 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":154,"threads_started":1}
I20260810 14:30:54.896003 9171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.885646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:47966)
0810 14:30:54.886034 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.886084 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.886228 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.886515 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.886519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.887035 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.887292 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.887304 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.888563 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.888568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.889507 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.889518 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.890121 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.890123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.890205 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.890721 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.890735 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.892523 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.894184 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.894191 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.894196 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.894477 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.894779 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.894782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.894784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.894882 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.895338 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.895343 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.895455 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.895583 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.895793 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":134,"threads_started":1}
I20260810 14:30:54.895980 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.885836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47966 (local address 127.1.206.126:42745)
0810 14:30:54.885962 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.885967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.886191 (+ 224us) server_negotiation.cc:407] Connection header received
0810 14:30:54.886317 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.886320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.886373 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.886470 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.887488 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.888416 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.889644 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.890000 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.890126 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.892665 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.892668 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.892670 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.892696 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.894084 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.894571 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.894574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.894575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.894678 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.894981 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.894984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.894985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.895205 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.895337 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.895660 (+ 323us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.895817 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:30:54.897058 9168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.124@KRBTEST.COM for oryx/127.1.206.125@KRBTEST.COM
I20260810 14:30:54.905370 9171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.897588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.0.0.1:33392)
0810 14:30:54.897735 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.897750 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.897830 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.898222 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.898225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.898356 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.898445 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.898450 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.899313 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.899315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.900020 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.900029 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.900535 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.900538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.900619 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.901050 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.901061 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.902337 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.903956 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.903959 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.903960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.904157 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.904490 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.904493 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.904494 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.904578 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.904983 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.904985 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.905063 (+ 78us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.905142 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.905252 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 14:30:54.905441 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.897748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.1.206.125:44183)
0810 14:30:54.898024 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.898027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.898039 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:30:54.898076 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.898078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.898117 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.898190 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.898543 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.899206 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.900137 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.900433 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.900518 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.902493 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.902496 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.902498 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.902522 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.903850 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.904245 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.904247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.904249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.904399 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.904661 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.904663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.904664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.904902 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.904981 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.905195 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.905318 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":117,"threads_started":1}
I20260810 14:30:54.906344 9168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372254, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.124@KRBTEST.COM for oryx/127.1.206.124@KRBTEST.COM
I20260810 14:30:54.915539 9171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.906856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.0.0.1:42216)
0810 14:30:54.907027 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.907043 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.907172 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.907430 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.907433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.907603 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.907669 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.907674 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.908862 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.908866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.909373 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.909380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.909823 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.909826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.909929 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.910544 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.910556 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.911996 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.913960 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.913963 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.913966 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.914173 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.914454 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.914457 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.914459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.914535 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.914942 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.914945 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.915038 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.915139 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.915311 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":21}
I20260810 14:30:54.915539 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.906967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42216 (local address 127.1.206.124:40121)
0810 14:30:54.907044 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.907049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.907092 (+ 43us) server_negotiation.cc:407] Connection header received
0810 14:30:54.907273 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.907276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.907308 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.907418 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.907776 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.908737 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.909484 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.909718 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.909825 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.912151 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.912156 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.912158 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.912184 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.913819 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.914271 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.914276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.914278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.914360 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.914627 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.914630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.914632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.914846 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.914956 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.915193 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.915363 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":26}
I20260810 14:30:54.918813 9168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Bootstrap starting.
I20260810 14:30:54.921319 9168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:54.922079 9168 log.cc:824] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:54.924351 9168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: No bootstrap required, opened a new log
I20260810 14:30:54.928468 9168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } }
I20260810 14:30:54.928717 9168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:54.928794 9168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7695f18d3531496b97bc02a78903868b, State: Initialized, Role: FOLLOWER
I20260810 14:30:54.929353 9168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } }
I20260810 14:30:54.929998 9174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } } }
I20260810 14:30:54.930124 9174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:30:54.930784 9168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: configured and running, proceeding with master startup.
W20260810 14:30:54.935768 9186 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:30:54.935866 9186 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:30:54.938939 9009 master_runner.cc:428] Detected that this master 7695f18d3531496b97bc02a78903868b is joining an existing cluster
I20260810 14:30:54.939010 9009 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.206.124:40121
I20260810 14:30:54.947266 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 8464
I20260810 14:30:54.954690 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:37967
--local_ip_for_outbound_sockets=127.1.206.65
--tserver_master_addrs=127.1.206.126:42745
--webserver_port=33413
--webserver_interface=127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab
--principal=oryx/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:30:54.979188 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.941605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47970 (local address 127.1.206.126:42745)
0810 14:30:54.941753 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.941758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.942461 (+ 703us) server_negotiation.cc:407] Connection header received
0810 14:30:54.942574 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.942579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.942638 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.942725 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.943408 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.944305 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.945564 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.945923 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.946009 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.974851 (+ 28842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.974860 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.974868 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.974909 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.976984 (+ 2075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.977519 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.977523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.977525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.977632 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.978002 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.978005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.978008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.978277 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.978367 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.978842 (+ 475us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.978985 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 14:30:54.979837 9194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.941539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:47970)
0810 14:30:54.942366 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.942380 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.942487 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.942769 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.942773 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.943105 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.943251 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.943260 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.944457 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.944460 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.945412 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.945423 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.946912 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.946916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.947019 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.972944 (+ 25925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.972971 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.973785 (+ 814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.977118 (+ 3333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.977122 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.977124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.977380 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.977760 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.977762 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.977764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.977891 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.978442 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.978447 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.978555 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.979463 (+ 908us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.979647 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"spinlock_wait_cycles":12160,"thread_start_us":143,"threads_started":1}
I20260810 14:30:54.980016 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.941653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33396 (local address 127.1.206.125:44183)
0810 14:30:54.941805 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.941809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.942818 (+ 1009us) server_negotiation.cc:407] Connection header received
0810 14:30:54.942936 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.942941 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.942997 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.943071 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.943728 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.944597 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.946435 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.947135 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.947225 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.974397 (+ 27172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.974403 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.974408 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.974447 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.976499 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.977258 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.977264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.977270 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.977390 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.978390 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.978396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.978401 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.978621 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.978700 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.979689 (+ 989us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.979843 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 14:30:54.980682 9192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.941875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.0.0.1:33396)
0810 14:30:54.942743 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.942757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.942845 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.943198 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.943204 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.943453 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.943588 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.943596 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.944736 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.944740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.946305 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.946312 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.947505 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.947509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.947607 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.948107 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.948125 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.974170 (+ 26045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.976682 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.976687 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.976689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.976967 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.978190 (+ 1223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.978193 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.978194 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.978275 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.979127 (+ 852us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.979129 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.979204 (+ 75us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.980326 (+ 1122us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.980503 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":50,"spinlock_wait_cycles":3840,"thread_start_us":106,"threads_started":1}
I20260810 14:30:54.982045 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.942259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42218 (local address 127.1.206.124:40121)
0810 14:30:54.942344 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.942348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.943111 (+ 763us) server_negotiation.cc:407] Connection header received
0810 14:30:54.943257 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.943261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.943299 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.943361 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.943903 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.944653 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.945913 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.946305 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.946416 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.947816 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.947820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.947824 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.947854 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.974562 (+ 26708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.977770 (+ 3208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.977773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.977774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.977876 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.978769 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.978773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.978775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.978991 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.979068 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.981780 (+ 2712us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.981912 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":39}
I20260810 14:30:54.982605 9193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.942013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.0.0.1:42218)
0810 14:30:54.943043 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.943058 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.943168 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.943487 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.943489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.943687 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.943798 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.943804 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.944758 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.944762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.945789 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.945800 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.946541 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.946544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.946624 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.947172 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.947192 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.947667 (+ 475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.977061 (+ 29394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.977065 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.977067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.977667 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.977978 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.977984 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.977986 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.978083 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.979367 (+ 1284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.979369 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.979482 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.982231 (+ 2749us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.982372 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":962,"mutex_wait_us":52,"thread_start_us":72,"threads_started":1}
Aug 10 14:30:54 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372253, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.126@KRBTEST.COM for oryx/127.1.206.124@KRBTEST.COM
I20260810 14:30:54.992365 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.984546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.0.0.1:42220)
0810 14:30:54.984690 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.984708 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.984801 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.985064 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.985067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.985255 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:54.985352 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.985358 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.986151 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.986155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.986698 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.986706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.987145 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.987149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:54.987253 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.987708 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:54.987720 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:54.989042 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:54.990793 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.990796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.990799 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.991017 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.991300 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:54.991304 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:54.991306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:54.991395 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:54.991770 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:54.991773 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:54.991887 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 14:30:54.991994 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 14:30:54.992171 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 14:30:54.992365 9170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.984683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42220 (local address 127.1.206.124:40121)
0810 14:30:54.984801 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.984805 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.984823 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:30:54.984907 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.984909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.984950 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.985045 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:54.985465 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.986033 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.986827 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.987037 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.987139 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:54.989190 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:54.989193 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:54.989195 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:54.989217 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:54.990674 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.991115 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.991119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.991121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.991201 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:54.991481 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:54.991486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:54.991488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:54.991672 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:54.991779 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:54.992048 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 14:30:54.992161 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 14:30:54.993710 8400 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.206.124:40121: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7695f18d3531496b97bc02a78903868b"
member_type: NON_VOTER
last_known_addr {
host: "127.1.206.124"
port: 40121
}
attrs {
promote: true
}
}
dest_uuid: "6865eb4902d14415af48b506b0db0cca"
cas_config_opid_index: 5
I20260810 14:30:54.994304 8400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } }
I20260810 14:30:54.995466 8998 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7695f18d3531496b97bc02a78903868b (127.1.206.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:54.996929 8998 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.206.124:40121
I20260810 14:30:54.997138 8998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:54.997252 8998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:54.997598 9009 master.cc:537] Master@127.1.206.124:40121 shutting down...
W20260810 14:30:54.999361 8383 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca -> Peer 7695f18d3531496b97bc02a78903868b (127.1.206.124:40121): Couldn't send request to peer 7695f18d3531496b97bc02a78903868b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 14:30:55.002799 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.997594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.0.0.1:33400)
0810 14:30:54.998252 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:54.998268 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:54.998361 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:54.998723 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:54.998726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:54.998743 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:54.998846 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:54.998854 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.999927 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:54.999930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.001181 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.001193 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.002385 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.002388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.002460 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.002494 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.002583 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.002667 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585}
I20260810 14:30:55.002799 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:54.997874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33400 (local address 127.1.206.125:44183)
0810 14:30:54.998156 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:54.998161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:54.998453 (+ 292us) server_negotiation.cc:407] Connection header received
0810 14:30:54.998513 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:54.998516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:54.998582 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:54.998698 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:54.998983 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:54.999730 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.001349 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.002013 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.002111 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.002274 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.002600 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.002676 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260810 14:30:55.003481 9052 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 LEARNER]: Refusing update from remote peer 6865eb4902d14415af48b506b0db0cca: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 14:30:55.004017 8996 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Connected to new peer: Peer: permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 14:30:55.004096 9009 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:55.004418 9009 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:55.004534 9009 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: stopping tablet replica
I20260810 14:30:55.006062 9052 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7695f18d3531496b97bc02a78903868b (127.1.206.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.007889 9083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.008051 9083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: LEARNER
I20260810 14:30:55.007870 9197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6865eb4902d14415af48b506b0db0cca. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: NON_VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: true } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.008371 9197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: LEARNER
I20260810 14:30:55.009753 8996 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: attempting to promote NON_VOTER 201a109babe647b591a4c45284a69c8b to VOTER
I20260810 14:30:55.010290 8996 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } }
I20260810 14:30:55.011844 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.011542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.0.0.1:42232)
0810 14:30:55.011665 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.011746 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:40121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 14:30:55.012080 9052 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 LEARNER]: Refusing update from remote peer 6865eb4902d14415af48b506b0db0cca: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 14:30:55.012666 8998 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Connected to new peer: Peer: permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 14:30:55.013098 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.012755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.0.0.1:42238)
0810 14:30:55.012964 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.013024 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:40121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
W20260810 14:30:55.013294 8383 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca -> Peer 7695f18d3531496b97bc02a78903868b (127.1.206.124:40121): Couldn't send request to peer 7695f18d3531496b97bc02a78903868b. Status: Network error: Client connection negotiation failed: client connection to 127.1.206.124:40121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 14:30:55.014277 8996 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 201a109babe647b591a4c45284a69c8b (127.1.206.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.015568 8996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.015684 8996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:55.015830 8998 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.015915 8998 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:55.016475 9052 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 201a109babe647b591a4c45284a69c8b (127.1.206.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.018239 9197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.018389 9197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:30:55.022061 9009 master.cc:552] Master@127.1.206.124:40121 shutdown complete.
I20260810 14:30:55.022136 9009 master_runner.cc:305] Clearing existing system tablet
I20260810 14:30:55.022383 9009 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:55.022454 9009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:55.023667 9009 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:30:55.024710 9200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.024950 9009 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:55.025101 9009 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:55.025139 9009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
uuid: "7695f18d3531496b97bc02a78903868b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "597fe30905242077180439ed36dadd52"
server_key_iv: "2d1737b19aff4fab2ed9ab1b489aa954"
server_key_version: "encryptionkey@0"
I20260810 14:30:55.026963 9009 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:55.028921 9009 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 14:30:55.029029 9009 log.cc:1196] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 14:30:55.029263 9009 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Deleting consensus metadata
I20260810 14:30:55.029608 9009 master_runner.cc:315] Copying system tablet from 127.1.206.126:42745
I20260810 14:30:55.030915 9009 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: tablet copy: Beginning tablet copy session from remote peer at address 127.1.206.126:42745
I20260810 14:30:55.040812 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.032746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47982 (local address 127.1.206.126:42745)
0810 14:30:55.032886 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.032891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.033152 (+ 261us) server_negotiation.cc:407] Connection header received
0810 14:30:55.033309 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.033312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.033370 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.033452 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.033964 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.034754 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.035771 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.036007 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.036170 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.037318 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.037322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.037325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.037350 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.039050 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.039488 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.039492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.039494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.039580 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.039866 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.039872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.039874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.040111 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.040219 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.040523 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.040638 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:30:55.040833 9207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.032672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:47982)
0810 14:30:55.033045 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.033057 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.033194 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.033469 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.033472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.033717 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.033827 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.033834 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.034875 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.034880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.035649 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.035660 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.036146 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.036150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.036246 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.036848 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.036860 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.037181 (+ 321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.039169 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.039173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.039175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.039383 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.039672 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.039675 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.039677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.039764 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.040219 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.040222 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.040354 (+ 132us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.040467 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.040635 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":107,"threads_started":1}
I20260810 14:30:55.041694 8422 tablet_copy_service.cc:140] P 6865eb4902d14415af48b506b0db0cca: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7695f18d3531496b97bc02a78903868b ({username='oryx', principal='oryx/127.1.206.124@KRBTEST.COM'} at 127.0.0.1:47982)
I20260810 14:30:55.041810 8422 tablet_copy_service.cc:161] P 6865eb4902d14415af48b506b0db0cca: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7695f18d3531496b97bc02a78903868b at {username='oryx', principal='oryx/127.1.206.124@KRBTEST.COM'} at 127.0.0.1:47982: session id = 7695f18d3531496b97bc02a78903868b-00000000000000000000000000000000
I20260810 14:30:55.042903 8422 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 14:30:55.044130 9009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 14:30:55.046195 9009 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: tablet copy: Starting download of 0 data blocks...
I20260810 14:30:55.046408 9009 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: tablet copy: Starting download of 1 WAL segments...
I20260810 14:30:55.047896 9009 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 14:30:55.049584 8422 tablet_copy_service.cc:342] P 6865eb4902d14415af48b506b0db0cca: Request end of tablet copy session 7695f18d3531496b97bc02a78903868b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.206.124@KRBTEST.COM'} at 127.0.0.1:47982
I20260810 14:30:55.049690 8422 tablet_copy_service.cc:433] P 6865eb4902d14415af48b506b0db0cca: ending tablet copy session 7695f18d3531496b97bc02a78903868b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7695f18d3531496b97bc02a78903868b
I20260810 14:30:55.056926 9009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:55.058630 9208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:55.058630 9211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:55.059065 9209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:55.059240 9009 server_base.cc:1034] running on GCE node
I20260810 14:30:55.059432 9009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:55.059762 9009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:55.059962 8744 heartbeater.cc:503] Master 127.1.206.126:42745 was elected leader, sending a full tablet report...
I20260810 14:30:55.060909 9009 hybrid_clock.cc:648] HybridClock initialized: now 1786372255060916 us; error 57 us; skew 500 ppm
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:55.062613 9009 init.cc:377] Logged in from keytab as oryx/127.1.206.124@KRBTEST.COM (short username oryx)
I20260810 14:30:55.063148 9009 webserver.cc:460] Webserver started at http://127.1.206.124:32987/ using document root <none> and password file <none>
I20260810 14:30:55.063349 9009 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:55.063402 9009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:55.064584 9009 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:30:55.065552 9218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.065791 9009 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:30:55.065888 9009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
uuid: "7695f18d3531496b97bc02a78903868b"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "597fe30905242077180439ed36dadd52"
server_key_iv: "2d1737b19aff4fab2ed9ab1b489aa954"
server_key_version: "encryptionkey@0"
I20260810 14:30:55.065999 9009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:55.091822 9009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:55.094075 9009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:55.099340 9009 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.124:40121
I20260810 14:30:55.099354 9274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.124:40121 every 8 connection(s)
I20260810 14:30:55.100028 9009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
I20260810 14:30:55.101528 9275 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:30:55.102504 9275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Bootstrap starting.
I20260810 14:30:55.112152 9275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:30:55.112687 9275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Bootstrap complete.
I20260810 14:30:55.113312 9275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } }
I20260810 14:30:55.113458 9275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7695f18d3531496b97bc02a78903868b, State: Initialized, Role: LEARNER
I20260810 14:30:55.113575 9275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } }
I20260810 14:30:55.113948 9278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.114128 9275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:30:55.114135 9278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: This master's current role is: LEARNER
I20260810 14:30:55.118651 9289 catalog_manager.cc:1259] Loaded cluster ID: eacd69e3ba5b4b7986c347ed9c29c021
I20260810 14:30:55.118747 9289 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: loading cluster ID for follower catalog manager: success
I20260810 14:30:55.120702 9289 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: acquiring CA information for follower catalog manager: success
I20260810 14:30:55.121978 9289 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 14:30:55.137423 9195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:55.137805 9195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:55.137868 9195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:55.144520 9195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:55.144618 9195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:55.144711 9195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:30:55.152931 9195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab
--principal=oryx/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:37967
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=33413
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:55.154299 9195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:55.155573 9195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:55.165844 9295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:55.165827 9294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:55.165830 9297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:55.166287 9195 server_base.cc:1034] running on GCE node
I20260810 14:30:55.166723 9195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:55.167457 9195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:55.168628 9195 hybrid_clock.cc:648] HybridClock initialized: now 1786372255168608 us; error 30 us; skew 500 ppm
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:55.171335 9195 init.cc:377] Logged in from keytab as oryx/127.1.206.65@KRBTEST.COM (short username oryx)
I20260810 14:30:55.172210 9195 webserver.cc:460] Webserver started at http://127.1.206.65:33413/ using document root <none> and password file <none>
I20260810 14:30:55.172818 9195 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:55.172897 9195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:55.177217 9195 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 14:30:55.179263 9305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.180684 9195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:30:55.180835 9195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "aee658ee993e4a71974d24e1019870ec"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "eb8f98cad3dd5e1088737f5cf3598307"
server_key_iv: "49452c0f5b0f3138c3697a0d49bffcea"
server_key_version: "encryptionkey@0"
I20260810 14:30:55.181430 9195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:55.191644 9195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:55.194981 9195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:55.195212 9195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:55.195834 9195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:55.196805 9195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:55.196877 9195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.196943 9195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:55.196996 9195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.206249 9195 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:37967
I20260810 14:30:55.206305 9426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:37967 every 8 connection(s)
I20260810 14:30:55.207409 9195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:30:55.214218 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 9195
I20260810 14:30:55.214452 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 8607
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.124@KRBTEST.COM
I20260810 14:30:55.227756 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.209404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:39985 (local address 127.1.206.126:42745)
0810 14:30:55.209546 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.209550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.211731 (+ 2181us) server_negotiation.cc:407] Connection header received
0810 14:30:55.212505 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.212509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.212572 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.212626 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.214289 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.215074 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.217082 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.217484 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.217571 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.222615 (+ 5044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.222620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.222622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.222672 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.225044 (+ 2372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.225740 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.225747 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.225751 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.225858 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.226259 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.226266 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.226270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.226532 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.226624 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.227354 (+ 730us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.227504 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.125@KRBTEST.COM
I20260810 14:30:55.228205 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:35473
--local_ip_for_outbound_sockets=127.1.206.66
--tserver_master_addrs=127.1.206.126:42745
--webserver_port=38791
--webserver_interface=127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab
--principal=oryx/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:30:55.228621 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.211408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:55835 (local address 127.1.206.124:40121)
0810 14:30:55.212051 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.212054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.212369 (+ 315us) server_negotiation.cc:407] Connection header received
0810 14:30:55.212586 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.212590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.212645 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.212735 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.214281 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.216924 (+ 2643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.218158 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.218542 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.218662 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.222646 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.222650 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.222653 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.222683 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.224916 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.225702 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.225706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.225708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.225803 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.226247 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.226251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.226253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.226499 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.226596 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.228247 (+ 1651us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.228432 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":87,"threads_started":1}
I20260810 14:30:55.229045 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.209928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:39985)
0810 14:30:55.211602 (+ 1674us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.211624 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.212291 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.212852 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.212860 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.213363 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.214100 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.214119 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.215388 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.215394 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.216925 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.216936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.217803 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.217809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.218227 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.219169 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.219186 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.222389 (+ 3203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.225238 (+ 2849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.225244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.225249 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.225609 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.225973 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.225979 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.225984 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.226136 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.226984 (+ 848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.226992 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.227117 (+ 125us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.227932 (+ 815us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.228099 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1234,"mutex_wait_us":246,"spinlock_wait_cycles":33152,"thread_start_us":217,"threads_started":1}
I20260810 14:30:55.229346 9433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.211301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.1.206.65:55835)
0810 14:30:55.212281 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.212298 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.212397 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.212865 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.212868 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.213395 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.214096 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.214119 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.217076 (+ 2957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.217080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.218013 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.218022 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.218651 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.218655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.218756 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.219457 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.219486 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.222388 (+ 2902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.225097 (+ 2709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.225106 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.225127 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.225569 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.225902 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.225905 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.225907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.226127 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.226658 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.226665 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.227014 (+ 349us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.227255 (+ 241us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.227672 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"mutex_wait_us":170,"spinlock_wait_cycles":25088,"thread_start_us":97,"threads_started":1}
I20260810 14:30:55.232065 9427 heartbeater.cc:347] Connected to a master server at 127.1.206.124:40121
I20260810 14:30:55.232154 9428 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42745
I20260810 14:30:55.232389 9427 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.232671 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.209404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:57801 (local address 127.1.206.125:44183)
0810 14:30:55.209715 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.209719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.211014 (+ 1295us) server_negotiation.cc:407] Connection header received
0810 14:30:55.212481 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.212485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.212553 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.212658 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.214294 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.215228 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.225736 (+ 10508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.226113 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.226216 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.228742 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.228745 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.228748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.228782 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.230761 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.231239 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.231242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.231243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.231327 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.231653 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.231665 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.231670 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.231890 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.231972 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.232373 (+ 401us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.232515 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260810 14:30:55.232745 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.209928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.1.206.65:57801)
0810 14:30:55.210639 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.210884 (+ 245us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.212220 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.212850 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.212857 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.213355 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.214095 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.214121 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.224532 (+ 10411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.224537 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.225570 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.225577 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.226407 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.226411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.226507 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.227017 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.227029 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.228545 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.230897 (+ 2352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.230901 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.230903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.231137 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.231431 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.231434 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.231437 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.231547 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.231985 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.231991 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.232103 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.232307 (+ 204us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.232468 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":53,"spinlock_wait_cycles":768,"thread_start_us":754,"threads_started":1}
I20260810 14:30:55.233033 9427 heartbeater.cc:511] Master 127.1.206.124:40121 requested a full tablet report, sending...
I20260810 14:30:55.233480 9429 heartbeater.cc:347] Connected to a master server at 127.1.206.125:44183
I20260810 14:30:55.233559 9429 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.232389 9428 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.233783 9428 heartbeater.cc:511] Master 127.1.206.126:42745 requested a full tablet report, sending...
I20260810 14:30:55.233819 9429 heartbeater.cc:511] Master 127.1.206.125:44183 requested a full tablet report, sending...
I20260810 14:30:55.234829 9237 ts_manager.cc:194] Registered new tserver with Master: aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967)
I20260810 14:30:55.234828 9042 ts_manager.cc:194] Registered new tserver with Master: aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967)
I20260810 14:30:55.235601 8400 ts_manager.cc:194] Re-registered known tserver with Master: aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967)
I20260810 14:30:55.236229 8400 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:39985
I20260810 14:30:55.285614 8888 heartbeater.cc:503] Master 127.1.206.126:42745 was elected leader, sending a full tablet report...
W20260810 14:30:55.348462 9435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:55.348734 9435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:55.348779 9435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:55.352828 9435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:55.352888 9435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:55.352985 9435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:30:55.358268 9435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab
--principal=oryx/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:35473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=38791
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:55.359395 9435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:55.360487 9435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:30:55.370683 9435 server_base.cc:1034] running on GCE node
W20260810 14:30:55.370612 9440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:55.370612 9441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:55.370615 9443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:55.371316 9435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:55.371968 9435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:55.373134 9435 hybrid_clock.cc:648] HybridClock initialized: now 1786372255373088 us; error 59 us; skew 500 ppm
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:55.376092 9435 init.cc:377] Logged in from keytab as oryx/127.1.206.66@KRBTEST.COM (short username oryx)
I20260810 14:30:55.377080 9435 webserver.cc:460] Webserver started at http://127.1.206.66:38791/ using document root <none> and password file <none>
I20260810 14:30:55.377717 9435 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:55.377820 9435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:55.381918 9435 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 14:30:55.384048 9450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.385553 9435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:55.385717 9435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "873b06cd53ae48828d8236de5b817e87"
format_stamp: "Formatted at 2026-08-10 14:30:53 on dist-test-slave-0b58"
server_key: "292ae45aae242403933b84f8e97b5bea"
server_key_iv: "8faf30300972653a5761bdb9c5803f20"
server_key_version: "encryptionkey@0"
I20260810 14:30:55.386405 9435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:55.403488 9435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:55.406741 9435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:55.406975 9435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:55.407657 9435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:55.408718 9435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:55.408774 9435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.408820 9435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:55.408878 9435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.419737 9435 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:35473
I20260810 14:30:55.419760 9572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:35473 every 8 connection(s)
I20260810 14:30:55.420848 9435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:30:55.428542 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 9435
I20260810 14:30:55.428750 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 8749
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.125@KRBTEST.COM
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.124@KRBTEST.COM
I20260810 14:30:55.437810 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.422710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:49503 (local address 127.1.206.125:44183)
0810 14:30:55.422868 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.422872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.423873 (+ 1001us) server_negotiation.cc:407] Connection header received
0810 14:30:55.425139 (+ 1266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.425143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.425200 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.425293 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.426829 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.427641 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.429065 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.429401 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.429482 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.433204 (+ 3722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.433208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.433211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.433255 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.435104 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.435810 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.435815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.435817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.435911 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.436388 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.436392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.436394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.436653 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.436743 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.437494 (+ 751us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.437635 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 14:30:55.438275 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.424619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:48247 (local address 127.1.206.124:40121)
0810 14:30:55.424760 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.424764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.425453 (+ 689us) server_negotiation.cc:407] Connection header received
0810 14:30:55.425534 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.425536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.425581 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.425671 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.426829 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.427641 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.430065 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.430453 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.430539 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.434196 (+ 3657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.434205 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.434212 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.434252 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.436060 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.436927 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.436931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.436932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.437020 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.437337 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.437340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.437342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.437564 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.437646 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.437998 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.438135 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 14:30:55.439457 9577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.423104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.1.206.66:49503)
0810 14:30:55.423727 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.423770 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.424900 (+ 1130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.425511 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.425522 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.426061 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.426669 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.426675 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.427795 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.427798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.428929 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.428942 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.429694 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.429700 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.429976 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.430912 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.430934 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.432976 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.435273 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.435281 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.435300 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.435677 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.436033 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.436036 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.436038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.436249 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.436810 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.436818 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.437170 (+ 352us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.437995 (+ 825us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.438370 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":214,"spinlock_wait_cycles":44800,"thread_start_us":175,"threads_started":1}
I20260810 14:30:55.439832 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.424496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.1.206.66:48247)
0810 14:30:55.425351 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.425364 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.425458 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.425689 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.425693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.426061 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.426664 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.426675 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.427795 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.427798 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.429928 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.429937 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.430733 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.430739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.430849 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.431431 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.431445 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.434017 (+ 2572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.436186 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.436188 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.436190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.436455 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.437130 (+ 675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.437133 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.437135 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.437223 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.437705 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.437708 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.437805 (+ 97us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.438426 (+ 621us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.438544 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"mutex_wait_us":1241,"spinlock_wait_cycles":22528,"thread_start_us":76,"threads_started":1}
I20260810 14:30:55.441162 9573 heartbeater.cc:347] Connected to a master server at 127.1.206.124:40121
I20260810 14:30:55.441411 9575 heartbeater.cc:347] Connected to a master server at 127.1.206.125:44183
I20260810 14:30:55.441422 9573 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.441540 9575 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.442111 9575 heartbeater.cc:511] Master 127.1.206.125:44183 requested a full tablet report, sending...
I20260810 14:30:55.442107 9573 heartbeater.cc:511] Master 127.1.206.124:40121 requested a full tablet report, sending...
I20260810 14:30:55.443598 9042 ts_manager.cc:194] Registered new tserver with Master: 873b06cd53ae48828d8236de5b817e87 (127.1.206.66:35473)
I20260810 14:30:55.443688 9237 ts_manager.cc:194] Registered new tserver with Master: 873b06cd53ae48828d8236de5b817e87 (127.1.206.66:35473)
I20260810 14:30:55.445374 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.423302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:55199 (local address 127.1.206.126:42745)
0810 14:30:55.423451 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.423457 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.424455 (+ 998us) server_negotiation.cc:407] Connection header received
0810 14:30:55.425139 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.425143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.425200 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.425293 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.426808 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.427358 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.428939 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.429388 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.429496 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.437032 (+ 7536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.437040 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.437047 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.437095 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.442997 (+ 5902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.443666 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.443670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.443672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.443773 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.444421 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.444424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.444426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.444700 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.444828 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.445098 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.445221 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 14:30:55.445387 9578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.423105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:55199)
0810 14:30:55.424353 (+ 1248us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.424369 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.424900 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.425993 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.425995 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.426132 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.426653 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.426666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.427512 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.427515 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.428748 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.428764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.429699 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.429705 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.429989 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.430826 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.430895 (+ 69us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.436797 (+ 5902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.443270 (+ 6473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.443274 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.443276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.443533 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.444173 (+ 640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.444175 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.444177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.444308 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.444833 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.444837 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.444931 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.445028 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.445191 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1157,"mutex_wait_us":70,"spinlock_wait_cycles":43776,"thread_start_us":913,"threads_started":1}
I20260810 14:30:55.446128 9574 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42745
I20260810 14:30:55.446236 9574 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.446417 9574 heartbeater.cc:511] Master 127.1.206.126:42745 requested a full tablet report, sending...
I20260810 14:30:55.447062 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:37893
--local_ip_for_outbound_sockets=127.1.206.67
--tserver_master_addrs=127.1.206.126:42745
--webserver_port=41839
--webserver_interface=127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab
--principal=oryx/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:30:55.447081 8400 ts_manager.cc:194] Re-registered known tserver with Master: 873b06cd53ae48828d8236de5b817e87 (127.1.206.66:35473)
I20260810 14:30:55.447674 8400 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:55199
I20260810 14:30:55.561362 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.557426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.0.0.1:42252)
0810 14:30:55.557726 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.557744 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.557909 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.558260 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.558264 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.558284 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:55.558410 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.558417 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.559174 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.559179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.560102 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.560115 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.560909 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.560913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.561005 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.561029 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.561105 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.561198 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":77,"threads_started":1}
I20260810 14:30:55.561357 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.557590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42252 (local address 127.1.206.124:40121)
0810 14:30:55.557739 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.557745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.557842 (+ 97us) server_negotiation.cc:407] Connection header received
0810 14:30:55.558026 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.558029 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.558088 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.558232 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:55.558530 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.559046 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.560240 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.560782 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.560898 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.561055 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.561139 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.561209 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 14:30:55.562320 9247 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 14:30:55.562769 9278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6865eb4902d14415af48b506b0db0cca. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.562925 9278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: This master's current role is: LEARNER
W20260810 14:30:55.565009 9580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:30:55.565289 9580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:30:55.565384 9580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:30:55.569869 9580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:30:55.569936 9580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:30:55.569999 9580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:30:55.575652 9580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab
--principal=oryx/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:37893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=41839
--tserver_master_addrs=127.1.206.126:42745,127.1.206.125:44183,127.1.206.124:40121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:30:55.576894 9580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:30:55.577973 9580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:30:55.587826 9587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:30:55.587836 9590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:55.587990 9580 server_base.cc:1034] running on GCE node
W20260810 14:30:55.588199 9588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:30:55.588703 9580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:30:55.589381 9580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:30:55.590570 9580 hybrid_clock.cc:648] HybridClock initialized: now 1786372255590544 us; error 33 us; skew 500 ppm
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:30:55.593482 9580 init.cc:377] Logged in from keytab as oryx/127.1.206.67@KRBTEST.COM (short username oryx)
I20260810 14:30:55.594388 9580 webserver.cc:460] Webserver started at http://127.1.206.67:41839/ using document root <none> and password file <none>
I20260810 14:30:55.594962 9580 fs_manager.cc:359] Metadata directory not provided
I20260810 14:30:55.595058 9580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:30:55.599030 9580 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:30:55.601363 9598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.602591 9580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:30:55.602725 9580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "9d601a9038fc4c7eac2903435704842a"
format_stamp: "Formatted at 2026-08-10 14:30:54 on dist-test-slave-0b58"
server_key: "a92555774cdc361331cf5c1ec1f766fd"
server_key_iv: "03ba446cd94a2454008c83a3d671407f"
server_key_version: "encryptionkey@0"
I20260810 14:30:55.603291 9580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:30:55.623318 9580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:30:55.626726 9580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:30:55.626930 9580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:30:55.627562 9580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:30:55.628499 9580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:30:55.628547 9580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.628607 9580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:30:55.628644 9580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:30:55.637845 9580 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:37893
I20260810 14:30:55.637871 9718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:37893 every 8 connection(s)
I20260810 14:30:55.638870 9580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:30:55.644682 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 9580
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.125@KRBTEST.COM
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
Aug 10 14:30:55 dist-test-slave-0b58 krb5kdc[8350](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372255, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.124@KRBTEST.COM
I20260810 14:30:55.658718 9172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.640791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44185 (local address 127.1.206.125:44183)
0810 14:30:55.640936 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.640941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.642014 (+ 1073us) server_negotiation.cc:407] Connection header received
0810 14:30:55.643277 (+ 1263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.643281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.643343 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.643423 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.644880 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.645687 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648135 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.648513 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648596 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.652874 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.652878 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.652880 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.652906 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.655803 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.656573 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.656578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.656582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.656681 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.657186 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.657191 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.657193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.657459 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.657558 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.658355 (+ 797us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.658505 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:30:55.659657 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.646917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33416 (local address 127.1.206.125:44183)
0810 14:30:55.647676 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.647682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.649219 (+ 1537us) server_negotiation.cc:407] Connection header received
0810 14:30:55.649421 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.649425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.649487 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.649572 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.650675 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.651520 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.652739 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.653085 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.653189 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.654976 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.654982 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.654988 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.655021 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.657500 (+ 2479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.658001 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.658004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.658006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.658087 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.658385 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.658388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.658390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.658598 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.658734 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.659359 (+ 625us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.659477 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":87,"threads_started":1}
I20260810 14:30:55.661862 8441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.640791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:39285 (local address 127.1.206.126:42745)
0810 14:30:55.640931 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.640934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.642445 (+ 1511us) server_negotiation.cc:407] Connection header received
0810 14:30:55.643401 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.643404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.643459 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.643536 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.644995 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.645749 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648129 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.648514 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648608 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.652238 (+ 3630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.652242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.652245 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.652301 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.654952 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.660149 (+ 5197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.660155 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.660156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.660247 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.660608 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.660614 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.660618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.660873 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.660975 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.661539 (+ 564us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.661664 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 14:30:55.661965 9734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.648048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42264 (local address 127.1.206.124:40121)
0810 14:30:55.648419 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.648423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.650090 (+ 1667us) server_negotiation.cc:407] Connection header received
0810 14:30:55.650285 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.650288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.650346 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.650409 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.651255 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.651816 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.652983 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.653388 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.653478 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.655230 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.655235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.655239 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.655269 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.659261 (+ 3992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.660092 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.660097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.660099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.660191 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.660822 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.660826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.660829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.661093 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.661247 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.661636 (+ 389us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.661800 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":72,"threads_started":1}
I20260810 14:30:55.662631 9724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.641316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:39285)
0810 14:30:55.642329 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.642343 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.643057 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.643674 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.643677 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.644076 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.644699 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.644716 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.645895 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.645899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.647996 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.648004 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.648739 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.648925 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.649738 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.649754 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.652020 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.655925 (+ 3905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.655932 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.655954 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.660030 (+ 4076us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.660390 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.660395 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.660400 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.660492 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.660982 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.660987 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.661091 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.661204 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.661874 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"mutex_wait_us":807,"spinlock_wait_cycles":46720,"thread_start_us":714,"threads_started":1}
I20260810 14:30:55.662631 9723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.641316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.1.206.67:44185)
0810 14:30:55.641854 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.641898 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.643057 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.643609 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.643615 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.644016 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.644694 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.644715 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.645893 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.645896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.647998 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.648004 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.648756 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.648929 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.649588 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.649603 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.652739 (+ 3136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.655925 (+ 3186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.655932 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.655954 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.656404 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.656826 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.656831 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.656833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.657047 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.657638 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.657646 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.658029 (+ 383us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.659180 (+ 1151us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.661312 (+ 2132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":565,"spinlock_wait_cycles":4992,"thread_start_us":153,"threads_started":1}
I20260810 14:30:55.663970 9720 heartbeater.cc:347] Connected to a master server at 127.1.206.126:42745
I20260810 14:30:55.664022 9721 heartbeater.cc:347] Connected to a master server at 127.1.206.125:44183
I20260810 14:30:55.664199 9721 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.664198 9720 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.664896 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.642655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:37493 (local address 127.1.206.124:40121)
0810 14:30:55.642782 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.642786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.642874 (+ 88us) server_negotiation.cc:407] Connection header received
0810 14:30:55.643401 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.643404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.643460 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.643536 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.644878 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.645709 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.647848 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.648176 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648324 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.656029 (+ 7705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.656033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.656039 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.656069 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.658029 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.661273 (+ 3244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.661276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.661278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.661378 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.663803 (+ 2425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.663807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.663809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.664127 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.664220 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.664624 (+ 404us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.664754 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:30:55.664906 9720 heartbeater.cc:511] Master 127.1.206.126:42745 requested a full tablet report, sending...
I20260810 14:30:55.664907 9721 heartbeater.cc:511] Master 127.1.206.125:44183 requested a full tablet report, sending...
I20260810 14:30:55.665426 9725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.642493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.1.206.67:37493)
0810 14:30:55.642788 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.642803 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.643057 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.643674 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.643677 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.644076 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:30:55.644697 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.644716 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.645895 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.645899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.647699 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.647709 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.648511 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.648515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.648730 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.649399 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:30:55.649423 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:30:55.655893 (+ 6470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:30:55.659608 (+ 3715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.659611 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.659613 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.661180 (+ 1567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.663582 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:30:55.663588 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:30:55.663590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:30:55.663689 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:30:55.664333 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:30:55.664335 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:30:55.664431 (+ 96us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.665092 (+ 661us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.665252 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":257,"spinlock_wait_cycles":32896,"thread_start_us":126,"threads_started":1}
I20260810 14:30:55.666107 8400 ts_manager.cc:194] Re-registered known tserver with Master: 9d601a9038fc4c7eac2903435704842a (127.1.206.67:37893)
I20260810 14:30:55.666137 9042 ts_manager.cc:194] Registered new tserver with Master: 9d601a9038fc4c7eac2903435704842a (127.1.206.67:37893)
I20260810 14:30:55.666154 9719 heartbeater.cc:347] Connected to a master server at 127.1.206.124:40121
I20260810 14:30:55.666230 9719 heartbeater.cc:464] Registering TS with master...
I20260810 14:30:55.666420 9719 heartbeater.cc:511] Master 127.1.206.124:40121 requested a full tablet report, sending...
I20260810 14:30:55.666913 8400 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:39285
I20260810 14:30:55.667054 9237 ts_manager.cc:194] Registered new tserver with Master: 9d601a9038fc4c7eac2903435704842a (127.1.206.67:37893)
I20260810 14:30:55.667614 9732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.647383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47998 (local address 127.1.206.126:42745)
0810 14:30:55.648575 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.648590 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.649492 (+ 902us) server_negotiation.cc:407] Connection header received
0810 14:30:55.656184 (+ 6692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.656188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.656280 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.656381 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.657337 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.658195 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.659332 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.659895 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.659995 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.661669 (+ 1674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.661672 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.661675 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.661698 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.664368 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.664864 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.664868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.664870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.664963 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.665282 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.665286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.665287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.665507 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.665644 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.667351 (+ 1707us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.667489 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1112,"thread_start_us":65,"threads_started":1}
I20260810 14:30:55.670713 8400 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:55.673861 8400 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:55.676637 9738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: NON_VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: true } } }
I20260810 14:30:55.676792 9738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:55.680220 9738 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: attempting to promote NON_VOTER 7695f18d3531496b97bc02a78903868b to VOTER
I20260810 14:30:55.680670 9738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:55.681973 9052 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Refusing update from remote peer 6865eb4902d14415af48b506b0db0cca: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 14:30:55.682025 9247 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 LEARNER]: Refusing update from remote peer 6865eb4902d14415af48b506b0db0cca: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 14:30:55.682408 9581 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Connected to new peer: Peer: permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 14:30:55.682694 9738 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [LEADER]: Connected to new peer: Peer: permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260810 14:30:55.683871 9581 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7695f18d3531496b97bc02a78903868b (127.1.206.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.685364 9745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.685401 9581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.685483 9745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:55.685425 9737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.685525 9581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:55.685536 9737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:55.685763 9052 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7695f18d3531496b97bc02a78903868b (127.1.206.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.686699 9247 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 7695f18d3531496b97bc02a78903868b (127.1.206.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.687122 9748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.687276 9748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:30:55.688625 9278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6865eb4902d14415af48b506b0db0cca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:55.688752 9278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:30:55.697570 9749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.692082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:35473 (local address 127.0.0.1:52654)
0810 14:30:55.692440 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.692457 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.692549 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.693429 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.693433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.693452 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:55.693558 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.693563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.694729 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.694732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.696014 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.696025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.697148 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.697152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.697246 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.697274 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.697332 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.697417 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":35,"thread_start_us":134,"threads_started":1}
I20260810 14:30:55.697714 9582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.691849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:37893 (local address 127.0.0.1:37998)
0810 14:30:55.692010 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.692028 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.692106 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.694148 (+ 2042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.694151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.694168 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:55.694254 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.694261 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.695363 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.695366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.696230 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.696242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.697276 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.697280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.697423 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.697448 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.697513 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.697593 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":64}
I20260810 14:30:55.698331 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.692317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52654 (local address 127.1.206.66:35473)
0810 14:30:55.692674 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.692687 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.692713 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:30:55.692800 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.692808 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.693071 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.693251 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:55.693669 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.694561 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.696151 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.697009 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.697873 (+ 864us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.698031 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.698085 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.698176 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":111,"threads_started":1}
I20260810 14:30:55.698827 9751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.692446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.1.206.67:37893)
0810 14:30:55.693786 (+ 1340us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.693795 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.693814 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:30:55.693877 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.693880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.694017 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.694170 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:55.694390 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.695230 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.696396 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.697134 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.698269 (+ 1135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.698533 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.698582 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.698673 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1239,"thread_start_us":123,"threads_started":1}
I20260810 14:30:55.699311 9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.692959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:37967 (local address 127.0.0.1:37464)
0810 14:30:55.694413 (+ 1454us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.694431 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.694535 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.695120 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.695123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.695141 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:55.695221 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.695226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.696552 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.696555 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.697681 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.697694 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.698920 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.698923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.699009 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.699031 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.699104 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.699185 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1391,"mutex_wait_us":22,"thread_start_us":89,"threads_started":1}
I20260810 14:30:55.699710 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.693119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37464 (local address 127.1.206.65:37967)
0810 14:30:55.693527 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.693545 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.694522 (+ 977us) server_negotiation.cc:407] Connection header received
0810 14:30:55.694645 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.694650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.694836 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.694979 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:55.695353 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.696428 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.697840 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.698621 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.698723 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.698855 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.699482 (+ 627us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.699576 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":109,"threads_started":1}
I20260810 14:30:55.701495 9502 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfa1c85f1254d0d856b5a9f30c92dba (DEFAULT_TABLE table=test-table [id=42c7d86963be4698aafa130ff3c34b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:55.702677 9502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfa1c85f1254d0d856b5a9f30c92dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:55.702338 9650 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfa1c85f1254d0d856b5a9f30c92dba (DEFAULT_TABLE table=test-table [id=42c7d86963be4698aafa130ff3c34b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:55.703347 9650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfa1c85f1254d0d856b5a9f30c92dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:55.703212 9356 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfa1c85f1254d0d856b5a9f30c92dba (DEFAULT_TABLE table=test-table [id=42c7d86963be4698aafa130ff3c34b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:55.704025 9356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfa1c85f1254d0d856b5a9f30c92dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:55.711933 9755 tablet_bootstrap.cc:492] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Bootstrap starting.
I20260810 14:30:55.712242 9754 tablet_bootstrap.cc:492] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Bootstrap starting.
I20260810 14:30:55.714547 9755 tablet_bootstrap.cc:654] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:55.714547 9754 tablet_bootstrap.cc:654] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:55.715575 9755 log.cc:824] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:55.715575 9754 log.cc:824] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:55.715633 9759 tablet_bootstrap.cc:492] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Bootstrap starting.
I20260810 14:30:55.717891 9754 tablet_bootstrap.cc:492] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: No bootstrap required, opened a new log
I20260810 14:30:55.717891 9755 tablet_bootstrap.cc:492] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: No bootstrap required, opened a new log
I20260810 14:30:55.718106 9754 ts_tablet_manager.cc:1397] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 14:30:55.718106 9755 ts_tablet_manager.cc:1397] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:30:55.719023 9759 tablet_bootstrap.cc:654] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:55.719949 9759 log.cc:824] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Log is configured to *not* fsync() on all Append() calls
I20260810 14:30:55.722947 9754 raft_consensus.cc:348] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.722947 9755 raft_consensus.cc:348] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.723241 9754 raft_consensus.cc:374] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:55.723250 9755 raft_consensus.cc:374] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:55.723304 9755 raft_consensus.cc:729] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d601a9038fc4c7eac2903435704842a, State: Initialized, Role: FOLLOWER
I20260810 14:30:55.723304 9754 raft_consensus.cc:729] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873b06cd53ae48828d8236de5b817e87, State: Initialized, Role: FOLLOWER
I20260810 14:30:55.723798 9754 consensus_queue.cc:260] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.723798 9755 consensus_queue.cc:260] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.724783 9574 heartbeater.cc:503] Master 127.1.206.126:42745 was elected leader, sending a full tablet report...
I20260810 14:30:55.724941 9754 ts_tablet_manager.cc:1428] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260810 14:30:55.724941 9755 ts_tablet_manager.cc:1428] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 14:30:55.726053 9720 heartbeater.cc:503] Master 127.1.206.126:42745 was elected leader, sending a full tablet report...
I20260810 14:30:55.729611 9759 tablet_bootstrap.cc:492] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: No bootstrap required, opened a new log
I20260810 14:30:55.729888 9759 ts_tablet_manager.cc:1397] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260810 14:30:55.733446 9759 raft_consensus.cc:348] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.733757 9759 raft_consensus.cc:374] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:55.733847 9759 raft_consensus.cc:729] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee658ee993e4a71974d24e1019870ec, State: Initialized, Role: FOLLOWER
I20260810 14:30:55.734270 9759 consensus_queue.cc:260] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.734872 9428 heartbeater.cc:503] Master 127.1.206.126:42745 was elected leader, sending a full tablet report...
I20260810 14:30:55.735234 9759 ts_tablet_manager.cc:1428] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 14:30:55.788427 9764 raft_consensus.cc:482] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:55.788677 9764 raft_consensus.cc:504] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.789888 9764 leader_election.cc:288] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 873b06cd53ae48828d8236de5b817e87 (127.1.206.66:35473), aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967)
I20260810 14:30:55.794217 9723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.790210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:37967 (local address 127.1.206.67:55021)
0810 14:30:55.790426 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.790442 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.790586 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.790892 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.790896 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.790911 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:55.791061 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.791068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.791978 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.791985 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.792940 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.792949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.793702 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.793705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.793818 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.793846 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.793939 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.794030 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":49,"spinlock_wait_cycles":8704}
I20260810 14:30:55.794282 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.790311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:55021 (local address 127.1.206.65:37967)
0810 14:30:55.790456 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.790461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.790553 (+ 92us) server_negotiation.cc:407] Connection header received
0810 14:30:55.790729 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.790732 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.790785 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.790860 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:55.791192 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.791863 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.793065 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.793581 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.793685 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.793731 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.794028 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.794123 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 14:30:55.794548 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.790301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:53065 (local address 127.1.206.66:35473)
0810 14:30:55.790435 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.790441 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.790516 (+ 75us) server_negotiation.cc:407] Connection header received
0810 14:30:55.790757 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.790761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.790820 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.790890 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:55.791230 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.791896 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.793398 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.793904 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.794020 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.794065 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.794320 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.794412 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 14:30:55.794639 9725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.790234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:35473 (local address 127.1.206.67:53065)
0810 14:30:55.790437 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:55.790453 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:55.790585 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:55.790998 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:55.791000 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:55.791014 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:55.791113 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.791119 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.792041 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.792043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.793265 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:55.793276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.794050 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.794055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:55.794165 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.794191 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 14:30:55.794287 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 14:30:55.794372 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":35,"spinlock_wait_cycles":9344}
I20260810 14:30:55.795432 9378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfa1c85f1254d0d856b5a9f30c92dba" candidate_uuid: "9d601a9038fc4c7eac2903435704842a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee658ee993e4a71974d24e1019870ec" is_pre_election: true
I20260810 14:30:55.795445 9523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfa1c85f1254d0d856b5a9f30c92dba" candidate_uuid: "9d601a9038fc4c7eac2903435704842a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873b06cd53ae48828d8236de5b817e87" is_pre_election: true
I20260810 14:30:55.795754 9378 raft_consensus.cc:2454] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d601a9038fc4c7eac2903435704842a in term 0.
I20260810 14:30:55.795776 9523 raft_consensus.cc:2454] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d601a9038fc4c7eac2903435704842a in term 0.
I20260810 14:30:55.796285 9600 leader_election.cc:302] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 873b06cd53ae48828d8236de5b817e87, 9d601a9038fc4c7eac2903435704842a, aee658ee993e4a71974d24e1019870ec; no voters:
I20260810 14:30:55.796620 9764 raft_consensus.cc:2781] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:55.796717 9764 raft_consensus.cc:482] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:55.796783 9764 raft_consensus.cc:3037] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:55.798053 9764 raft_consensus.cc:504] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.798529 9764 leader_election.cc:288] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [CANDIDATE]: Term 1 election: Requested vote from peers 873b06cd53ae48828d8236de5b817e87 (127.1.206.66:35473), aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967)
I20260810 14:30:55.799011 9523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfa1c85f1254d0d856b5a9f30c92dba" candidate_uuid: "9d601a9038fc4c7eac2903435704842a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873b06cd53ae48828d8236de5b817e87"
I20260810 14:30:55.799062 9378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfa1c85f1254d0d856b5a9f30c92dba" candidate_uuid: "9d601a9038fc4c7eac2903435704842a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee658ee993e4a71974d24e1019870ec"
I20260810 14:30:55.799161 9523 raft_consensus.cc:3037] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:55.799226 9378 raft_consensus.cc:3037] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:55.800542 9378 raft_consensus.cc:2454] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d601a9038fc4c7eac2903435704842a in term 1.
I20260810 14:30:55.800639 9523 raft_consensus.cc:2454] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d601a9038fc4c7eac2903435704842a in term 1.
I20260810 14:30:55.800899 9600 leader_election.cc:302] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d601a9038fc4c7eac2903435704842a, aee658ee993e4a71974d24e1019870ec; no voters:
I20260810 14:30:55.801105 9764 raft_consensus.cc:2781] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:55.801400 9764 raft_consensus.cc:686] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 1 LEADER]: Becoming Leader. State: Replica: 9d601a9038fc4c7eac2903435704842a, State: Running, Role: LEADER
I20260810 14:30:55.801872 9764 consensus_queue.cc:237] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } }
I20260810 14:30:55.805929 8400 catalog_manager.cc:5495] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d601a9038fc4c7eac2903435704842a (127.1.206.67). New cstate: current_term: 1 leader_uuid: "9d601a9038fc4c7eac2903435704842a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } health_report { overall_health: UNKNOWN } } }
I20260810 14:30:55.824180 9751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.820444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38012 (local address 127.1.206.67:37893)
0810 14:30:55.820592 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.820596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.820612 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:30:55.820720 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.820723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.820786 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.820880 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:55.821102 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.821715 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.822528 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.822753 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.822835 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.823165 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:55.823720 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:55.823824 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.823893 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.823949 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:30:55.830689 9378 raft_consensus.cc:1261] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 1 FOLLOWER]: Refusing update from remote peer 9d601a9038fc4c7eac2903435704842a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:55.830689 9523 raft_consensus.cc:1261] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 1 FOLLOWER]: Refusing update from remote peer 9d601a9038fc4c7eac2903435704842a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:55.831475 9766 consensus_queue.cc:1035] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:55.831686 9764 consensus_queue.cc:1035] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [LEADER]: Connected to new peer: Peer: permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:55.840477 9769 mvcc.cc:205] Tried to move back new op lower bound from 7316980759874703360 to 7316980759768027136. Current Snapshot: MvccSnapshot[applied={T|T < 7316980759874703360}]
I20260810 14:30:55.841536 9771 mvcc.cc:205] Tried to move back new op lower bound from 7316980759874703360 to 7316980759768027136. Current Snapshot: MvccSnapshot[applied={T|T < 7316980759874703360}]
I20260810 14:30:55.844113 9770 mvcc.cc:205] Tried to move back new op lower bound from 7316980759874703360 to 7316980759768027136. Current Snapshot: MvccSnapshot[applied={T|T < 7316980759874703360}]
I20260810 14:30:55.852643 8399 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:55.852831 8399 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47998:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:55.858078 8399 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6865eb4902d14415af48b506b0db0cca: Sending DeleteTablet for 3 replicas of tablet 9bfa1c85f1254d0d856b5a9f30c92dba
I20260810 14:30:55.858867 9502 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bfa1c85f1254d0d856b5a9f30c92dba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:55 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:52654
I20260810 14:30:55.858937 9356 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bfa1c85f1254d0d856b5a9f30c92dba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:55 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:37464
I20260810 14:30:55.859467 9779 tablet_replica.cc:330] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: stopping tablet replica
I20260810 14:30:55.859448 9650 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bfa1c85f1254d0d856b5a9f30c92dba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:55 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:37998
I20260810 14:30:55.859905 9781 tablet_replica.cc:330] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: stopping tablet replica
I20260810 14:30:55.860222 9781 raft_consensus.cc:2229] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:55.860230 9779 raft_consensus.cc:2229] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:55.860769 9779 raft_consensus.cc:2258] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:55.861816 9780 tablet_replica.cc:330] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: stopping tablet replica
I20260810 14:30:55.862280 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 8365
I20260810 14:30:55.865406 9779 ts_tablet_manager.cc:1905] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:55.868619 9781 raft_consensus.cc:2258] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:55.868999 9779 ts_tablet_manager.cc:1918] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:55.869095 9779 log.cc:1196] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/9bfa1c85f1254d0d856b5a9f30c92dba
I20260810 14:30:55.869446 9779 ts_tablet_manager.cc:1939] T 9bfa1c85f1254d0d856b5a9f30c92dba P 873b06cd53ae48828d8236de5b817e87: Deleting consensus metadata
I20260810 14:30:55.872144 9781 ts_tablet_manager.cc:1905] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 14:30:55.874512 9454 connection.cc:535] server connection from 127.0.0.1:52654 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:30:55.875015 9781 ts_tablet_manager.cc:1918] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:55.875123 9781 log.cc:1196] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/9bfa1c85f1254d0d856b5a9f30c92dba
I20260810 14:30:55.875499 9781 ts_tablet_manager.cc:1939] T 9bfa1c85f1254d0d856b5a9f30c92dba P 9d601a9038fc4c7eac2903435704842a: Deleting consensus metadata
I20260810 14:30:55.875494 9780 raft_consensus.cc:2229] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:55.875913 9780 raft_consensus.cc:2258] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 14:30:55.877140 9599 connection.cc:441] server connection from 127.0.0.1:37998 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37998 (request call id 1) could send its response
I20260810 14:30:55.878249 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.861432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33428 (local address 127.1.206.125:44183)
0810 14:30:55.861554 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.861559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.861574 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:30:55.861694 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.861698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.861767 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.861831 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.865865 (+ 4034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.866922 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.868748 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.869277 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.869388 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.872722 (+ 3334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.872730 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.872736 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.872789 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.874902 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.875971 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.875975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.875977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.876081 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.876991 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.876995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.876996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.877260 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.877400 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.877896 (+ 496us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.878068 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 14:30:55.881042 9780 ts_tablet_manager.cc:1905] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:55.883939 9780 ts_tablet_manager.cc:1918] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:55.884065 9780 log.cc:1196] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/9bfa1c85f1254d0d856b5a9f30c92dba
I20260810 14:30:55.884536 9780 ts_tablet_manager.cc:1939] T 9bfa1c85f1254d0d856b5a9f30c92dba P aee658ee993e4a71974d24e1019870ec: Deleting consensus metadata
W20260810 14:30:55.885974 9306 connection.cc:441] server connection from 127.0.0.1:37464 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37464 (request call id 1) could send its response
I20260810 14:30:55.890285 9434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.861238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42278 (local address 127.1.206.124:40121)
0810 14:30:55.861746 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.861751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.880134 (+ 18383us) server_negotiation.cc:407] Connection header received
0810 14:30:55.880347 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.880351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.880410 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.880495 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.881370 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.882208 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.883343 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.883771 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.883901 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.885930 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.885935 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.885938 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.885970 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.888047 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.888775 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.888781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.888785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.888882 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.889226 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.889230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.889232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.889474 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.889601 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.889966 (+ 365us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.890083 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422}
I20260810 14:30:55.896220 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.879503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33438 (local address 127.1.206.125:44183)
0810 14:30:55.879614 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.879618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.886712 (+ 7094us) server_negotiation.cc:407] Connection header received
0810 14:30:55.886895 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.886898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.886948 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.887008 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.887962 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.888842 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.890027 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.890376 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.890448 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.892454 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.892458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.892461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.892489 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.894333 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.894850 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.894854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.894856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.894976 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.895272 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.895276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.895278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.895472 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.895619 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.895893 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.896026 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:30:55.897982 9734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:55.886779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.1.206.124:40121)
0810 14:30:55.886916 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:55.886923 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:55.887801 (+ 878us) server_negotiation.cc:407] Connection header received
0810 14:30:55.888005 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:55.888011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:55.888059 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:55.888116 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:30:55.889152 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.890081 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.891701 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:55.892053 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:55.892136 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:55.893911 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:30:55.893915 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:30:55.893918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:30:55.893948 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:30:55.895950 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.896504 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.896508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.896510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.896610 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:30:55.896981 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:30:55.896985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:30:55.896987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:30:55.897203 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:30:55.897311 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:55.897642 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 14:30:55.897752 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 14:30:56.845564 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:56.845047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:43085)
0810 14:30:56.845336 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:56.845441 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":81,"threads_started":1}
I20260810 14:30:56.845715 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:56.845187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:49371)
0810 14:30:56.845495 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:56.845585 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":58,"threads_started":1}
I20260810 14:30:56.845896 9791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:56.845136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:43861)
0810 14:30:56.845524 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:56.845610 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":71,"threads_started":1}
W20260810 14:30:56.845887 9720 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:42745 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
W20260810 14:30:56.846158 9574 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:42745 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
W20260810 14:30:56.846202 9428 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:42745 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
I20260810 14:30:57.358111 9793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6865eb4902d14415af48b506b0db0cca)
I20260810 14:30:57.358412 9794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6865eb4902d14415af48b506b0db0cca)
I20260810 14:30:57.358405 9793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:57.358615 9794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:57.360683 9796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.359752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48402)
0810 14:30:57.360469 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.360567 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":76,"threads_started":1}
I20260810 14:30:57.360809 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.359747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48386)
0810 14:30:57.360631 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.360712 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":810,"thread_start_us":73,"threads_started":1}
I20260810 14:30:57.360770 9794 leader_election.cc:288] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745), 201a109babe647b591a4c45284a69c8b (127.1.206.125:44183)
W20260810 14:30:57.361145 9220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
W20260810 14:30:57.361342 9023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
I20260810 14:30:57.362061 9793 leader_election.cc:288] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745), 7695f18d3531496b97bc02a78903868b (127.1.206.124:40121)
I20260810 14:30:57.362772 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.362241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48414)
0810 14:30:57.362590 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.362671 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273}
I20260810 14:30:57.362829 9796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.362538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48420)
0810 14:30:57.362680 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.362737 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260810 14:30:57.362882 9023 leader_election.cc:334] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745): Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
W20260810 14:30:57.362933 9220 leader_election.cc:334] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745): Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
I20260810 14:30:57.366837 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.360248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:40121 (local address 127.0.0.1:42304)
0810 14:30:57.360974 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.360991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:57.361107 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:57.362546 (+ 1439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:57.362550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:57.362572 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:57.362664 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:57.362679 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.364077 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.364080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:57.365487 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:57.365499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.366457 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.366464 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:57.366554 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:57.366580 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 14:30:57.366635 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:30:57.366707 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":59,"threads_started":1}
I20260810 14:30:57.367093 9798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.360348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:44183 (local address 127.0.0.1:33452)
0810 14:30:57.361103 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.361117 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:57.361222 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:57.361620 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:57.361623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:57.361776 (+ 153us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:57.361909 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:57.361918 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.364023 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.364028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:57.365369 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:57.365383 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.366559 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.366564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:57.366728 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:57.366761 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 14:30:57.366847 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 14:30:57.366943 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":56,"threads_started":1}
I20260810 14:30:57.367326 9802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.361866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42304 (local address 127.1.206.124:40121)
0810 14:30:57.362244 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:57.362254 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:57.362267 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:30:57.362319 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:57.362322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:57.362363 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:57.362781 (+ 418us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:57.363125 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.363980 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.365650 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.366282 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.367018 (+ 736us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:57.367092 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:57.367140 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 14:30:57.367214 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":105,"threads_started":1}
I20260810 14:30:57.367587 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.360618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33452 (local address 127.1.206.125:44183)
0810 14:30:57.360980 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:57.360986 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:57.361312 (+ 326us) server_negotiation.cc:407] Connection header received
0810 14:30:57.361367 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:57.361373 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:57.361424 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:57.361504 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:57.362044 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.363900 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.365529 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:57.366311 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:57.366420 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:57.366494 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:57.367342 (+ 848us) server_negotiation.cc:299] Negotiation successful
0810 14:30:57.367444 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":72,"threads_started":1}
I20260810 14:30:57.367731 9247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "201a109babe647b591a4c45284a69c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7695f18d3531496b97bc02a78903868b" is_pre_election: true
I20260810 14:30:57.367972 9247 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 201a109babe647b591a4c45284a69c8b in term 1.
I20260810 14:30:57.367985 9052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7695f18d3531496b97bc02a78903868b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "201a109babe647b591a4c45284a69c8b" is_pre_election: true
I20260810 14:30:57.368182 9052 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7695f18d3531496b97bc02a78903868b in term 1.
I20260810 14:30:57.368386 9023 leader_election.cc:302] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 201a109babe647b591a4c45284a69c8b, 7695f18d3531496b97bc02a78903868b; no voters: 6865eb4902d14415af48b506b0db0cca
I20260810 14:30:57.368614 9222 leader_election.cc:302] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 201a109babe647b591a4c45284a69c8b, 7695f18d3531496b97bc02a78903868b; no voters: 6865eb4902d14415af48b506b0db0cca
I20260810 14:30:57.368661 9793 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 14:30:57.368716 9793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6865eb4902d14415af48b506b0db0cca)
I20260810 14:30:57.368760 9793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:30:57.368824 9794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 14:30:57.368912 9794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6865eb4902d14415af48b506b0db0cca)
I20260810 14:30:57.368968 9794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:30:57.370234 9793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:57.370419 9794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:57.370747 9793 leader_election.cc:288] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [CANDIDATE]: Term 2 election: Requested vote from peers 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745), 7695f18d3531496b97bc02a78903868b (127.1.206.124:40121)
I20260810 14:30:57.370813 9794 leader_election.cc:288] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 2 election: Requested vote from peers 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745), 201a109babe647b591a4c45284a69c8b (127.1.206.125:44183)
I20260810 14:30:57.371174 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.370886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48444)
0810 14:30:57.371012 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.371079 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 14:30:57.371507 9798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.371181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48458)
0810 14:30:57.371383 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.371438 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260810 14:30:57.371587 9052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7695f18d3531496b97bc02a78903868b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "201a109babe647b591a4c45284a69c8b"
I20260810 14:30:57.371753 9052 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7695f18d3531496b97bc02a78903868b in current term 2: Already voted for candidate 201a109babe647b591a4c45284a69c8b in this term.
I20260810 14:30:57.372155 9247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "201a109babe647b591a4c45284a69c8b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7695f18d3531496b97bc02a78903868b"
I20260810 14:30:57.372357 9247 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 201a109babe647b591a4c45284a69c8b in current term 2: Already voted for candidate 7695f18d3531496b97bc02a78903868b in this term.
I20260810 14:30:57.372486 9798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.372197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48462)
0810 14:30:57.372376 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.372425 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260810 14:30:57.372520 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.372235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48460)
0810 14:30:57.372423 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.372466 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
W20260810 14:30:57.372570 9220 leader_election.cc:334] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745): Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
I20260810 14:30:57.372632 9220 leader_election.cc:302] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7695f18d3531496b97bc02a78903868b; no voters: 201a109babe647b591a4c45284a69c8b, 6865eb4902d14415af48b506b0db0cca
W20260810 14:30:57.372776 9023 leader_election.cc:334] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745): Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
I20260810 14:30:57.372803 9794 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 14:30:57.373006 9023 leader_election.cc:302] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 201a109babe647b591a4c45284a69c8b; no voters: 6865eb4902d14415af48b506b0db0cca, 7695f18d3531496b97bc02a78903868b
I20260810 14:30:57.373162 9793 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 14:30:57.846923 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.846427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:52395)
0810 14:30:57.846716 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.846804 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":86,"threads_started":1}
I20260810 14:30:57.847098 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.846669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:53249)
0810 14:30:57.846932 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.846998 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":68,"threads_started":1}
I20260810 14:30:57.847355 9805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:57.846840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:44783)
0810 14:30:57.847096 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:57.847152 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":63,"threads_started":1}
I20260810 14:30:58.848305 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.847762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:39733)
0810 14:30:58.848071 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.848143 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":77,"threads_started":1}
I20260810 14:30:58.848510 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.847724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:39235)
0810 14:30:58.848345 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.848409 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":92,"threads_started":1}
I20260810 14:30:58.848577 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.848079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:34233)
0810 14:30:58.848430 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.848483 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":81,"threads_started":1}
I20260810 14:30:58.885708 9809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:58.885890 9809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:58.886353 9809 leader_election.cc:288] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745), 201a109babe647b591a4c45284a69c8b (127.1.206.125:44183)
I20260810 14:30:58.886785 9052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7695f18d3531496b97bc02a78903868b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "201a109babe647b591a4c45284a69c8b" is_pre_election: true
I20260810 14:30:58.886931 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.886540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48702)
0810 14:30:58.886774 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.886831 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":86,"threads_started":1}
I20260810 14:30:58.886940 9052 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7695f18d3531496b97bc02a78903868b in term 2.
I20260810 14:30:58.887274 9222 leader_election.cc:302] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201a109babe647b591a4c45284a69c8b, 7695f18d3531496b97bc02a78903868b; no voters:
I20260810 14:30:58.887461 9809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 14:30:58.887534 9809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:58.887590 9809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 2 FOLLOWER]: Advancing to term 3
I20260810 14:30:58.887698 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.887466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48710)
0810 14:30:58.887575 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.887631 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 14:30:58.887837 9220 leader_election.cc:334] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745): Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
I20260810 14:30:58.888821 9809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:58.889184 9809 leader_election.cc:288] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 3 election: Requested vote from peers 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745), 201a109babe647b591a4c45284a69c8b (127.1.206.125:44183)
I20260810 14:30:58.889501 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.889289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48724)
0810 14:30:58.889400 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.889450 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 14:30:58.889539 9052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7695f18d3531496b97bc02a78903868b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "201a109babe647b591a4c45284a69c8b"
I20260810 14:30:58.889686 9052 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 2 FOLLOWER]: Advancing to term 3
I20260810 14:30:58.890204 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.890022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48730)
0810 14:30:58.890114 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.890157 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 14:30:58.890355 9220 leader_election.cc:334] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745): Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
I20260810 14:30:58.890865 9052 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7695f18d3531496b97bc02a78903868b in term 3.
I20260810 14:30:58.891175 9222 leader_election.cc:302] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 201a109babe647b591a4c45284a69c8b, 7695f18d3531496b97bc02a78903868b; no voters: 6865eb4902d14415af48b506b0db0cca
I20260810 14:30:58.891376 9809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 3 FOLLOWER]: Leader election won for term 3
I20260810 14:30:58.891603 9809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [term 3 LEADER]: Becoming Leader. State: Replica: 7695f18d3531496b97bc02a78903868b, State: Running, Role: LEADER
I20260810 14:30:58.891876 9809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } }
I20260810 14:30:58.893477 9812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7695f18d3531496b97bc02a78903868b. Latest consensus state: current_term: 3 leader_uuid: "7695f18d3531496b97bc02a78903868b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:58.893608 9812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:58.893909 9814 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:30:58.896363 9814 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:30:58.896776 9814 catalog_manager.cc:1259] Loaded cluster ID: eacd69e3ba5b4b7986c347ed9c29c021
I20260810 14:30:58.896826 9814 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:30:58.897396 9814 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:30:58.897787 9814 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Loaded TSK: 0
I20260810 14:30:58.898464 9814 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:30:58.963327 9236 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42294:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:30:58.966557 9236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:30:58.969997 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.969699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48754)
0810 14:30:58.969844 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.969913 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 14:30:58.970063 9052 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [term 3 FOLLOWER]: Refusing update from remote peer 7695f18d3531496b97bc02a78903868b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260810 14:30:58.970553 9809 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [LEADER]: Connected to new peer: Peer: permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 14:30:58.970772 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.970534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.0.0.1:48766)
0810 14:30:58.970645 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.970701 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 14:30:58.970933 9220 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b -> Peer 6865eb4902d14415af48b506b0db0cca (127.1.206.126:42745): Couldn't send request to peer 6865eb4902d14415af48b506b0db0cca. Status: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 14:30:58.972154 9816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7695f18d3531496b97bc02a78903868b. Latest consensus state: current_term: 3 leader_uuid: "7695f18d3531496b97bc02a78903868b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:58.972334 9816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:30:58.973405 9809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7695f18d3531496b97bc02a78903868b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:58.973544 9809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b [sys.catalog]: This master's current role is: LEADER
I20260810 14:30:58.974201 9816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7695f18d3531496b97bc02a78903868b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6865eb4902d14415af48b506b0db0cca" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 42745 } } peers { permanent_uuid: "201a109babe647b591a4c45284a69c8b" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 44183 } attrs { promote: false } } peers { permanent_uuid: "7695f18d3531496b97bc02a78903868b" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 40121 } attrs { promote: false } } }
I20260810 14:30:58.974327 9816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 201a109babe647b591a4c45284a69c8b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:30:58.984557 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.979801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:37967 (local address 127.0.0.1:37470)
0810 14:30:58.979921 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.979937 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:58.980026 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:58.980939 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:58.980941 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:58.980960 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:58.981073 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:58.981080 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.982114 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.982118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:58.983177 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:58.983187 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.984098 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.984101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:58.984186 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:58.984220 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 14:30:58.984318 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 14:30:58.984415 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 14:30:58.985025 9826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.980433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38028 (local address 127.1.206.67:37893)
0810 14:30:58.981069 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:58.981074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:58.981088 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:30:58.981145 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:58.981150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:58.981203 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:58.981554 (+ 351us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:58.981685 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.982472 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.983589 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.984146 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.984675 (+ 529us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:58.984748 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:58.984798 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 14:30:58.984876 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":77,"threads_started":1}
I20260810 14:30:58.985231 9825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.980410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:35473 (local address 127.0.0.1:52658)
0810 14:30:58.980643 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.980657 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:58.980748 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:58.981435 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:58.981438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:58.981452 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:58.981540 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:58.981546 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.982593 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.982596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:58.983755 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:58.983765 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.984835 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.984839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:58.984921 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:58.984943 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:30:58.985013 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 14:30:58.985092 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":28,"thread_start_us":91,"threads_started":1}
I20260810 14:30:58.985433 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.980062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:37893 (local address 127.0.0.1:38028)
0810 14:30:58.980516 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.980532 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:58.980627 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:58.981323 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:58.981326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:58.981342 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:58.981439 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:58.981445 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.982623 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.982626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:58.983460 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:58.983469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.984318 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.984322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:58.984415 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:58.984441 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 14:30:58.984496 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:30:58.984571 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":26,"thread_start_us":90,"threads_started":1}
I20260810 14:30:58.985457 9824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.980166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37470 (local address 127.1.206.65:37967)
0810 14:30:58.980713 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:58.980718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:58.980731 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:30:58.980785 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:58.980787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:58.980832 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:58.980928 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:58.981198 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.981971 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.983336 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.983970 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.984956 (+ 986us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:58.985021 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:58.985102 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 14:30:58.985201 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":159,"threads_started":1}
I20260810 14:30:58.985677 9827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.980797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52658 (local address 127.1.206.66:35473)
0810 14:30:58.981050 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:58.981055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:58.981068 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:30:58.981118 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:58.981120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:58.981180 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:58.981264 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:58.981663 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.982472 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.983878 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:58.984582 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:58.984719 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:58.984778 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:58.985421 (+ 643us) server_negotiation.cc:299] Negotiation successful
0810 14:30:58.985514 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":64,"threads_started":1}
I20260810 14:30:58.985996 9356 tablet_service.cc:1467] Processing CreateTablet for tablet ba269eacc78f4ce9b7814056033fdd6f (DEFAULT_TABLE table=test-table [id=6c7fee8e046e4e088c04c05df3dfecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:58.985999 9650 tablet_service.cc:1467] Processing CreateTablet for tablet ba269eacc78f4ce9b7814056033fdd6f (DEFAULT_TABLE table=test-table [id=6c7fee8e046e4e088c04c05df3dfecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:58.986306 9356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba269eacc78f4ce9b7814056033fdd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:58.986328 9650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba269eacc78f4ce9b7814056033fdd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:58.988644 9829 tablet_bootstrap.cc:492] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec: Bootstrap starting.
I20260810 14:30:58.989037 9502 tablet_service.cc:1467] Processing CreateTablet for tablet ba269eacc78f4ce9b7814056033fdd6f (DEFAULT_TABLE table=test-table [id=6c7fee8e046e4e088c04c05df3dfecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:30:58.989118 9830 tablet_bootstrap.cc:492] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Bootstrap starting.
I20260810 14:30:58.989333 9502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba269eacc78f4ce9b7814056033fdd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:30:58.989751 9829 tablet_bootstrap.cc:654] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:58.990075 9830 tablet_bootstrap.cc:654] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:58.991017 9829 tablet_bootstrap.cc:492] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec: No bootstrap required, opened a new log
I20260810 14:30:58.991096 9829 ts_tablet_manager.cc:1397] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:58.991523 9829 raft_consensus.cc:348] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:58.991648 9829 raft_consensus.cc:374] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:58.991689 9829 raft_consensus.cc:729] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee658ee993e4a71974d24e1019870ec, State: Initialized, Role: FOLLOWER
I20260810 14:30:58.992300 9830 tablet_bootstrap.cc:492] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: No bootstrap required, opened a new log
I20260810 14:30:58.992393 9830 ts_tablet_manager.cc:1397] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:58.992430 9833 tablet_bootstrap.cc:492] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: Bootstrap starting.
I20260810 14:30:58.992394 9829 consensus_queue.cc:260] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:58.992957 9830 raft_consensus.cc:348] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:58.993080 9830 raft_consensus.cc:374] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:58.993119 9830 raft_consensus.cc:729] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d601a9038fc4c7eac2903435704842a, State: Initialized, Role: FOLLOWER
I20260810 14:30:58.993391 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.993147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:36831)
0810 14:30:58.993242 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.993305 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 14:30:58.993508 9830 consensus_queue.cc:260] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:58.993754 9829 ts_tablet_manager.cc:1428] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 14:30:58.994197 9830 ts_tablet_manager.cc:1428] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:30:58.994375 9833 tablet_bootstrap.cc:654] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: Neither blocks nor log segments found. Creating new log.
I20260810 14:30:58.994475 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.994153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:51739)
0810 14:30:58.994361 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.994414 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260810 14:30:58.995543 9833 tablet_bootstrap.cc:492] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: No bootstrap required, opened a new log
I20260810 14:30:58.995612 9427 heartbeater.cc:503] Master 127.1.206.124:40121 was elected leader, sending a full tablet report...
I20260810 14:30:58.995639 9833 ts_tablet_manager.cc:1397] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:30:58.996034 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.995741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:60245)
0810 14:30:58.995912 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.995965 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260810 14:30:58.996062 9833 raft_consensus.cc:348] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:58.996168 9833 raft_consensus.cc:374] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:30:58.996206 9833 raft_consensus.cc:729] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873b06cd53ae48828d8236de5b817e87, State: Initialized, Role: FOLLOWER
I20260810 14:30:58.996392 9833 consensus_queue.cc:260] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:58.996783 9833 ts_tablet_manager.cc:1428] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:30:58.997540 9719 heartbeater.cc:503] Master 127.1.206.124:40121 was elected leader, sending a full tablet report...
I20260810 14:30:58.998077 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.997461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:46123)
0810 14:30:58.997938 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.997998 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392}
I20260810 14:30:58.998757 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.998514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:46897)
0810 14:30:58.998642 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.998693 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260810 14:30:58.999496 9573 heartbeater.cc:503] Master 127.1.206.124:40121 was elected leader, sending a full tablet report...
I20260810 14:30:58.999534 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:58.999269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:48229)
0810 14:30:58.999408 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:58.999468 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 14:30:59.101759 9837 raft_consensus.cc:482] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:30:59.101979 9837 raft_consensus.cc:504] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:59.103297 9837 leader_election.cc:288] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967), 9d601a9038fc4c7eac2903435704842a (127.1.206.67:37893)
I20260810 14:30:59.107851 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.103463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:37967 (local address 127.1.206.66:46383)
0810 14:30:59.103921 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.103938 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:59.104061 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:59.104341 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:59.104343 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:59.104359 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:59.104452 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:59.104456 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.105302 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.105308 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:59.106458 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:59.106469 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.107355 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.107359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:59.107469 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:59.107511 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 14:30:59.107581 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 14:30:59.107683 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":1,"spinlock_wait_cycles":3968}
I20260810 14:30:59.108083 9838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.103515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:37893 (local address 127.1.206.66:58889)
0810 14:30:59.103923 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.103937 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:30:59.104061 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:30:59.104595 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:30:59.104597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:30:59.104613 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:30:59.104709 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:59.104714 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.105705 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.105709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:59.106788 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:30:59.106800 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.107570 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.107574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:30:59.107751 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:59.107777 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 14:30:59.107862 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:30:59.107934 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":37,"spinlock_wait_cycles":8832,"thread_start_us":138,"threads_started":1}
I20260810 14:30:59.108376 9824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.103717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:46383 (local address 127.1.206.65:37967)
0810 14:30:59.103840 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:59.103845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:59.104021 (+ 176us) server_negotiation.cc:407] Connection header received
0810 14:30:59.104157 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:59.104160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:59.104210 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:59.104316 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:59.104572 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.105188 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.106580 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.107201 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.107332 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:59.107382 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:59.108135 (+ 753us) server_negotiation.cc:299] Negotiation successful
0810 14:30:59.108231 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:30:59.108518 9826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.103622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:58889 (local address 127.1.206.67:37893)
0810 14:30:59.103770 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:59.103775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:59.104063 (+ 288us) server_negotiation.cc:407] Connection header received
0810 14:30:59.104449 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:59.104452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:59.104496 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:59.104559 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:30:59.104829 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.105588 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.106902 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.107430 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.107560 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:59.107614 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:59.108308 (+ 694us) server_negotiation.cc:299] Negotiation successful
0810 14:30:59.108398 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 14:30:59.108815 9378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba269eacc78f4ce9b7814056033fdd6f" candidate_uuid: "873b06cd53ae48828d8236de5b817e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee658ee993e4a71974d24e1019870ec" is_pre_election: true
I20260810 14:30:59.108973 9378 raft_consensus.cc:2454] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873b06cd53ae48828d8236de5b817e87 in term 0.
I20260810 14:30:59.108938 9670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba269eacc78f4ce9b7814056033fdd6f" candidate_uuid: "873b06cd53ae48828d8236de5b817e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d601a9038fc4c7eac2903435704842a" is_pre_election: true
I20260810 14:30:59.109185 9670 raft_consensus.cc:2454] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873b06cd53ae48828d8236de5b817e87 in term 0.
I20260810 14:30:59.109670 9453 leader_election.cc:302] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 873b06cd53ae48828d8236de5b817e87, 9d601a9038fc4c7eac2903435704842a, aee658ee993e4a71974d24e1019870ec; no voters:
I20260810 14:30:59.109951 9837 raft_consensus.cc:2781] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:30:59.110024 9837 raft_consensus.cc:482] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:30:59.110072 9837 raft_consensus.cc:3037] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:59.111368 9837 raft_consensus.cc:504] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:59.111779 9837 leader_election.cc:288] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [CANDIDATE]: Term 1 election: Requested vote from peers aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967), 9d601a9038fc4c7eac2903435704842a (127.1.206.67:37893)
I20260810 14:30:59.112138 9378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba269eacc78f4ce9b7814056033fdd6f" candidate_uuid: "873b06cd53ae48828d8236de5b817e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee658ee993e4a71974d24e1019870ec"
I20260810 14:30:59.112195 9670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba269eacc78f4ce9b7814056033fdd6f" candidate_uuid: "873b06cd53ae48828d8236de5b817e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d601a9038fc4c7eac2903435704842a"
I20260810 14:30:59.112293 9378 raft_consensus.cc:3037] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:59.112363 9670 raft_consensus.cc:3037] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:30:59.113482 9378 raft_consensus.cc:2454] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873b06cd53ae48828d8236de5b817e87 in term 1.
I20260810 14:30:59.113482 9670 raft_consensus.cc:2454] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873b06cd53ae48828d8236de5b817e87 in term 1.
I20260810 14:30:59.113768 9453 leader_election.cc:302] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 873b06cd53ae48828d8236de5b817e87, 9d601a9038fc4c7eac2903435704842a; no voters:
I20260810 14:30:59.113965 9837 raft_consensus.cc:2781] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:30:59.114207 9837 raft_consensus.cc:686] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 1 LEADER]: Becoming Leader. State: Replica: 873b06cd53ae48828d8236de5b817e87, State: Running, Role: LEADER
I20260810 14:30:59.114487 9837 consensus_queue.cc:237] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } }
I20260810 14:30:59.114964 9838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.114690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:42627)
0810 14:30:59.114807 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.114888 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 14:30:59.117128 9235 catalog_manager.cc:5495] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 873b06cd53ae48828d8236de5b817e87 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "873b06cd53ae48828d8236de5b817e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873b06cd53ae48828d8236de5b817e87" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 35473 } health_report { overall_health: HEALTHY } } }
I20260810 14:30:59.140754 9827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.137113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52674 (local address 127.1.206.66:35473)
0810 14:30:59.137253 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:30:59.137258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:30:59.137305 (+ 47us) server_negotiation.cc:407] Connection header received
0810 14:30:59.137400 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:30:59.137403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:30:59.137460 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:30:59.137572 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:30:59.137836 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.138357 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.139208 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:30:59.139443 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:30:59.139557 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:30:59.139848 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:30:59.140359 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:30:59.140480 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 14:30:59.140546 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 14:30:59.140608 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 14:30:59.142988 9722 tablet.cc:2369] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:30:59.143684 9378 raft_consensus.cc:1261] T ba269eacc78f4ce9b7814056033fdd6f P aee658ee993e4a71974d24e1019870ec [term 1 FOLLOWER]: Refusing update from remote peer 873b06cd53ae48828d8236de5b817e87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:59.143846 9670 raft_consensus.cc:1261] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 1 FOLLOWER]: Refusing update from remote peer 873b06cd53ae48828d8236de5b817e87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:30:59.144234 9837 consensus_queue.cc:1035] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee658ee993e4a71974d24e1019870ec" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:59.144480 9839 consensus_queue.cc:1035] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d601a9038fc4c7eac2903435704842a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:30:59.147290 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.146727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:59463)
0810 14:30:59.147118 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.147190 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311}
I20260810 14:30:59.148239 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.147755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:46759)
0810 14:30:59.148086 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.148157 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251}
I20260810 14:30:59.150800 9838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.150368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.66:44437)
0810 14:30:59.150661 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.150724 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222}
I20260810 14:30:59.152150 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.151856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.65:43653)
0810 14:30:59.152032 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.152082 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260810 14:30:59.156879 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.156616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:42745 (local address 127.1.206.67:50853)
0810 14:30:59.156714 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.156787 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:42745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:30:59.157740 9235 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:59.157912 9235 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42294:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:30:59.162751 9235 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7695f18d3531496b97bc02a78903868b: Sending DeleteTablet for 3 replicas of tablet ba269eacc78f4ce9b7814056033fdd6f
I20260810 14:30:59.163589 9356 tablet_service.cc:1514] Processing DeleteTablet for tablet ba269eacc78f4ce9b7814056033fdd6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:59 UTC) from {username='oryx', principal='oryx/127.1.206.124@KRBTEST.COM'} at 127.0.0.1:37470
I20260810 14:30:59.163637 9502 tablet_service.cc:1514] Processing DeleteTablet for tablet ba269eacc78f4ce9b7814056033fdd6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:59 UTC) from {username='oryx', principal='oryx/127.1.206.124@KRBTEST.COM'} at 127.0.0.1:52658
I20260810 14:30:59.163633 9650 tablet_service.cc:1514] Processing DeleteTablet for tablet ba269eacc78f4ce9b7814056033fdd6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:30:59 UTC) from {username='oryx', principal='oryx/127.1.206.124@KRBTEST.COM'} at 127.0.0.1:38028
I20260810 14:30:59.164105 9854 tablet_replica.cc:330] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: stopping tablet replica
I20260810 14:30:59.164299 9854 raft_consensus.cc:2229] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:30:59.164449 9854 raft_consensus.cc:2258] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:59.164852 9855 tablet_replica.cc:330] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: stopping tablet replica
I20260810 14:30:59.165014 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 9195
I20260810 14:30:59.165004 9855 raft_consensus.cc:2229] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:30:59.165428 9855 raft_consensus.cc:2258] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:30:59.174340 9854 ts_tablet_manager.cc:1905] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:59.176745 9855 ts_tablet_manager.cc:1905] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:30:59.177233 9854 ts_tablet_manager.cc:1918] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:59.177331 9854 log.cc:1196] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/ba269eacc78f4ce9b7814056033fdd6f
I20260810 14:30:59.177639 9854 ts_tablet_manager.cc:1939] T ba269eacc78f4ce9b7814056033fdd6f P 9d601a9038fc4c7eac2903435704842a: Deleting consensus metadata
I20260810 14:30:59.178483 9221 catalog_manager.cc:4841] TS 9d601a9038fc4c7eac2903435704842a (127.1.206.67:37893): tablet ba269eacc78f4ce9b7814056033fdd6f (table test-table [id=6c7fee8e046e4e088c04c05df3dfecdb]) successfully deleted
I20260810 14:30:59.179667 9855 ts_tablet_manager.cc:1918] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:30:59.179771 9855 log.cc:1196] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/ba269eacc78f4ce9b7814056033fdd6f
I20260810 14:30:59.180234 9855 ts_tablet_manager.cc:1939] T ba269eacc78f4ce9b7814056033fdd6f P 873b06cd53ae48828d8236de5b817e87: Deleting consensus metadata
I20260810 14:30:59.180807 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 9435
I20260810 14:30:59.183853 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.180610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:37967 (local address 127.0.0.1:37474)
0810 14:30:59.183709 (+ 3099us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.183775 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:37967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3006}
W20260810 14:30:59.184023 9220 catalog_manager.cc:4584] TS aee658ee993e4a71974d24e1019870ec (127.1.206.65:37967): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba269eacc78f4ce9b7814056033fdd6f: Network error: Client connection negotiation failed: client connection to 127.1.206.65:37967: connect: Connection refused (error 111)
I20260810 14:30:59.189436 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 9580
I20260810 14:30:59.189659 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:30:59.189343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:35473 (local address 127.0.0.1:52682)
0810 14:30:59.189465 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 14:30:59.189555 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.66:35473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 14:30:59.198189 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 8895
I20260810 14:30:59.206175 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 9009
2026-08-10T14:30:59Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7110 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:30:59 dist-test-slave-0b58 krb5kdc[9858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:30:59 dist-test-slave-0b58 krb5kdc[9858](info): set up 2 sockets
Aug 10 14:30:59 dist-test-slave-0b58 krb5kdc[9858](info): commencing operation
krb5kdc: starting...
W20260810 14:31:00.311409 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:31:00 dist-test-slave-0b58 krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:31:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:31:00Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab.
Entry for principal oryx/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab.
I20260810 14:31:00.443408 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:33539
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab
--principal=oryx/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:44915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:33539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:00.559140 9871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:00.559437 9871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:00.559478 9871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:00.563545 9871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:31:00.563618 9871 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 14:31:00.563637 9871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:00.563655 9871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:00.563671 9871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:31:00.563686 9871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:31:00.569088 9871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:33539
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.126.keytab
--principal=oryx/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:33539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:00.570134 9871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:00.571115 9871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:00.580070 9879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:00.580080 9876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:00.580304 9871 server_base.cc:1034] running on GCE node
W20260810 14:31:00.580080 9877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:00.580960 9871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:00.582177 9871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:00.583387 9871 hybrid_clock.cc:648] HybridClock initialized: now 1786372260583361 us; error 54 us; skew 500 ppm
Aug 10 14:31:00 dist-test-slave-0b58 krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372260, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:00.591426 9871 init.cc:377] Logged in from keytab as oryx/127.1.206.126@KRBTEST.COM (short username oryx)
I20260810 14:31:00.592509 9871 webserver.cc:460] Webserver started at http://127.1.206.126:39633/ using document root <none> and password file <none>
I20260810 14:31:00.593112 9871 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:00.593209 9871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:00.593446 9871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:00.595570 9871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "776e31622c244721bf7b82b589b16a90"
format_stamp: "Formatted at 2026-08-10 14:31:00 on dist-test-slave-0b58"
server_key: "808b01b511bd876b70d28fc10d251953"
server_key_iv: "7b3de05b12f8a1101f7cd90bbec52b0a"
server_key_version: "encryptionkey@0"
I20260810 14:31:00.596186 9871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "776e31622c244721bf7b82b589b16a90"
format_stamp: "Formatted at 2026-08-10 14:31:00 on dist-test-slave-0b58"
server_key: "808b01b511bd876b70d28fc10d251953"
server_key_iv: "7b3de05b12f8a1101f7cd90bbec52b0a"
server_key_version: "encryptionkey@0"
I20260810 14:31:00.600041 9871 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 14:31:00.602792 9886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:00.604169 9871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:00.604365 9871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "776e31622c244721bf7b82b589b16a90"
format_stamp: "Formatted at 2026-08-10 14:31:00 on dist-test-slave-0b58"
server_key: "808b01b511bd876b70d28fc10d251953"
server_key_iv: "7b3de05b12f8a1101f7cd90bbec52b0a"
server_key_version: "encryptionkey@0"
I20260810 14:31:00.604506 9871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:00.621291 9871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:00.625061 9871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:00.625308 9871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:00.634166 9871 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:33539
I20260810 14:31:00.634195 9952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:33539 every 8 connection(s)
I20260810 14:31:00.635251 9871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:31:00.638235 9953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:00.641268 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 9871
I20260810 14:31:00.641433 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:31:00.641782 1849 external_mini_cluster.cc:1428] Setting key aaa12b9f3b97ad415af8a5eb270f3379
I20260810 14:31:00.645287 9953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Bootstrap starting.
I20260810 14:31:00.647730 9953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:00.648640 9953 log.cc:824] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:00.651335 9953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: No bootstrap required, opened a new log
Aug 10 14:31:00 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:31:00.655375 9953 raft_consensus.cc:348] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776e31622c244721bf7b82b589b16a90" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33539 } }
I20260810 14:31:00.655675 9953 raft_consensus.cc:374] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:00.655768 9953 raft_consensus.cc:729] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 776e31622c244721bf7b82b589b16a90, State: Initialized, Role: FOLLOWER
I20260810 14:31:00.656345 9953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776e31622c244721bf7b82b589b16a90" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33539 } }
I20260810 14:31:00.656523 9953 raft_consensus.cc:388] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:31:00.656594 9953 raft_consensus.cc:482] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:31:00.656692 9953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:00.657783 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:00.643500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49722 (local address 127.1.206.126:33539)
0810 14:31:00.644010 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:00.644025 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:00.644064 (+ 39us) server_negotiation.cc:407] Connection header received
0810 14:31:00.644837 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:00.644857 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:00.645209 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:00.645597 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:00.646508 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.647545 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.648601 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.649255 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.649449 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:00.652487 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:00.652493 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:00.652508 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:00.652541 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:00.654471 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:00.655020 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:00.655025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:00.655030 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:00.655158 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:00.655472 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:00.655476 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:00.655478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:00.656029 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:00.656329 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:00.656619 (+ 290us) server_negotiation.cc:299] Negotiation successful
0810 14:31:00.656944 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":149,"threads_started":1}
I20260810 14:31:00.657759 9953 raft_consensus.cc:504] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776e31622c244721bf7b82b589b16a90" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33539 } }
I20260810 14:31:00.658201 9953 leader_election.cc:302] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 776e31622c244721bf7b82b589b16a90; no voters:
I20260810 14:31:00.658558 9953 leader_election.cc:288] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:31:00.658705 9959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:00.658933 9959 raft_consensus.cc:686] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [term 1 LEADER]: Becoming Leader. State: Replica: 776e31622c244721bf7b82b589b16a90, State: Running, Role: LEADER
I20260810 14:31:00.659266 9959 consensus_queue.cc:237] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776e31622c244721bf7b82b589b16a90" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33539 } }
I20260810 14:31:00.659888 9953 sys_catalog.cc:564] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:31:00.660518 9959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 776e31622c244721bf7b82b589b16a90. Latest consensus state: current_term: 1 leader_uuid: "776e31622c244721bf7b82b589b16a90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776e31622c244721bf7b82b589b16a90" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33539 } } }
I20260810 14:31:00.660645 9959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:00.661070 9960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "776e31622c244721bf7b82b589b16a90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "776e31622c244721bf7b82b589b16a90" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 33539 } } }
I20260810 14:31:00.661211 9960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:00.661073 9964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:31:00.664516 9964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:31:00.671233 9964 catalog_manager.cc:1347] Generated new cluster ID: b36636c8126e41de87498c3921b4aa9b
I20260810 14:31:00.671340 9964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:31:00.695642 9964 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:31:00.696772 9964 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:31:00.708398 9964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Generated new TSK 0
I20260810 14:31:00.709367 9964 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab.
Entry for principal oryx/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab.
I20260810 14:31:00.747058 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33539
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab
--principal=oryx/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:44915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:00.865083 9983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:00.865382 9983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:00.865463 9983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:00.869753 9983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:00.869839 9983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:00.869884 9983 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:31:00.869953 9983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:31:00.875608 9983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab
--principal=oryx/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:33539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:00.876848 9983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:00.877942 9983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:00.888176 9989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:00.888176 9988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:00.888208 9992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:00.888492 9983 server_base.cc:1034] running on GCE node
I20260810 14:31:00.889004 9983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:00.889642 9983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:00.890834 9983 hybrid_clock.cc:648] HybridClock initialized: now 1786372260890820 us; error 28 us; skew 500 ppm
Aug 10 14:31:00 dist-test-slave-0b58 krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372260, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:00.893802 9983 init.cc:377] Logged in from keytab as oryx/127.1.206.65@KRBTEST.COM (short username oryx)
I20260810 14:31:00.894757 9983 webserver.cc:460] Webserver started at http://127.1.206.65:40263/ using document root <none> and password file <none>
I20260810 14:31:00.895354 9983 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:00.895450 9983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:00.895695 9983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:00.897938 9983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "0aaa0714476444db96d0b00543f2a323"
format_stamp: "Formatted at 2026-08-10 14:31:00 on dist-test-slave-0b58"
server_key: "f3e6605ae03b203ef40abfa5ddafb193"
server_key_iv: "049dd6c6788742733738219ac64bdf93"
server_key_version: "encryptionkey@0"
I20260810 14:31:00.898546 9983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "0aaa0714476444db96d0b00543f2a323"
format_stamp: "Formatted at 2026-08-10 14:31:00 on dist-test-slave-0b58"
server_key: "f3e6605ae03b203ef40abfa5ddafb193"
server_key_iv: "049dd6c6788742733738219ac64bdf93"
server_key_version: "encryptionkey@0"
I20260810 14:31:00.902652 9983 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 14:31:00.905303 9999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:00.906718 9983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:31:00.906893 9983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "0aaa0714476444db96d0b00543f2a323"
format_stamp: "Formatted at 2026-08-10 14:31:00 on dist-test-slave-0b58"
server_key: "f3e6605ae03b203ef40abfa5ddafb193"
server_key_iv: "049dd6c6788742733738219ac64bdf93"
server_key_version: "encryptionkey@0"
I20260810 14:31:00.907028 9983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:00.919647 9983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:00.922724 9983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:00.922974 9983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:00.924655 9983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:00.924741 9983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:00.924814 9983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:00.924850 9983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:31:00 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372260, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:31:00.936707 9983 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:44297
I20260810 14:31:00.936725 10121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:44297 every 8 connection(s)
I20260810 14:31:00.937657 9983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:31:00.940084 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:00.925532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:43061 (local address 127.1.206.126:33539)
0810 14:31:00.925694 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:00.925699 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:00.926823 (+ 1124us) server_negotiation.cc:407] Connection header received
0810 14:31:00.928298 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:00.928303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:00.928379 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:00.928483 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:00.929946 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.930885 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.932696 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.932966 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.933098 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:00.936105 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:00.936113 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:00.936119 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:00.936158 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:00.938054 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:00.938713 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:00.938717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:00.938718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:00.938807 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:00.939098 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:00.939101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:00.939102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:00.939290 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:00.939387 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:00.939847 (+ 460us) server_negotiation.cc:299] Negotiation successful
0810 14:31:00.939961 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:31:00.941237 10008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:00.926012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33539 (local address 127.1.206.65:43061)
0810 14:31:00.926585 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:00.926669 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:00.927961 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:00.928673 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:00.928681 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:00.929065 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:00.929744 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:00.929775 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.931068 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.931072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:00.932539 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:00.932555 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.933164 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.933168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:00.933373 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:00.934100 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:00.934121 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:00.935876 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:00.938231 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:00.938237 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:00.938252 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:00.938603 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:00.938885 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:00.938887 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:00.938888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:00.939018 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:00.939400 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:00.939405 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:00.939638 (+ 233us) client_negotiation.cc:769] Sending connection context
0810 14:31:00.939803 (+ 165us) client_negotiation.cc:240] Negotiation successful
0810 14:31:00.940063 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":114,"threads_started":1}
I20260810 14:31:00.942948 10122 heartbeater.cc:347] Connected to a master server at 127.1.206.126:33539
I20260810 14:31:00.943126 10122 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:00.943681 10122 heartbeater.cc:511] Master 127.1.206.126:33539 requested a full tablet report, sending...
I20260810 14:31:00.945245 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 9983
I20260810 14:31:00.945385 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:31:00.945541 9903 ts_manager.cc:194] Registered new tserver with Master: 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297)
I20260810 14:31:00.945761 1849 external_mini_cluster.cc:1428] Setting key d9cc4a70ca110a14de20958ff7859bb9
I20260810 14:31:00.947252 9903 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:43061
I20260810 14:31:00.954384 10130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:00.945419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33539 (local address 127.1.206.65:39513)
0810 14:31:00.945884 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:00.945901 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:00.946012 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:00.946315 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:00.946318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:00.946535 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:00.946683 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:00.946691 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.947770 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.947776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:00.948838 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:00.948854 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.949614 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.949618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:00.949724 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:00.950330 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:00.950343 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:00.950691 (+ 348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:00.952818 (+ 2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:00.952822 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:00.952824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:00.953054 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:00.953360 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:00.953362 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:00.953363 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:00.953439 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:00.953930 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:00.953932 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:00.954012 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 14:31:00.954093 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 14:31:00.954212 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":253,"threads_started":1}
I20260810 14:31:00.954560 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:00.945475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:39513 (local address 127.1.206.126:33539)
0810 14:31:00.945611 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:00.945617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:00.945994 (+ 377us) server_negotiation.cc:407] Connection header received
0810 14:31:00.946125 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:00.946128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:00.946180 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:00.946293 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:00.946809 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.947618 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.948990 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:00.949340 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:00.949460 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:00.950854 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:00.950860 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:00.950866 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:00.950899 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:00.952694 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:00.953161 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:00.953166 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:00.953168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:00.953263 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:00.953535 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:00.953542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:00.953546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:00.953832 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:00.953952 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:00.954192 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 14:31:00.954342 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
WARNING: no policy specified for oryx/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab.
Entry for principal oryx/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab.
I20260810 14:31:00.975534 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33539
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab
--principal=oryx/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:44915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:01.092137 10133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:01.092522 10133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:01.092572 10133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:01.096818 10133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:01.096891 10133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:01.096933 10133 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:31:01.096968 10133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:31:01.102706 10133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab
--principal=oryx/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:33539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:01.103801 10133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:01.104912 10133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:01.115309 10141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:01.115250 10139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:01.115250 10138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:01.115482 10133 server_base.cc:1034] running on GCE node
I20260810 14:31:01.116122 10133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:01.116835 10133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:01.118000 10133 hybrid_clock.cc:648] HybridClock initialized: now 1786372261117979 us; error 40 us; skew 500 ppm
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372261, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:01.121016 10133 init.cc:377] Logged in from keytab as oryx/127.1.206.66@KRBTEST.COM (short username oryx)
I20260810 14:31:01.121918 10133 webserver.cc:460] Webserver started at http://127.1.206.66:35591/ using document root <none> and password file <none>
I20260810 14:31:01.122474 10133 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:01.122541 10133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:01.122714 10133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:01.124984 10133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "21875d1c2f0f4dea85ef522a10300a0e"
format_stamp: "Formatted at 2026-08-10 14:31:01 on dist-test-slave-0b58"
server_key: "c41fb4b3a52d033c9308273722061a10"
server_key_iv: "b91926f1a1f1040064e04c1e0340bed2"
server_key_version: "encryptionkey@0"
I20260810 14:31:01.125643 10133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "21875d1c2f0f4dea85ef522a10300a0e"
format_stamp: "Formatted at 2026-08-10 14:31:01 on dist-test-slave-0b58"
server_key: "c41fb4b3a52d033c9308273722061a10"
server_key_iv: "b91926f1a1f1040064e04c1e0340bed2"
server_key_version: "encryptionkey@0"
I20260810 14:31:01.129829 10133 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:31:01.132843 10148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:01.134205 10133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:31:01.134351 10133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "21875d1c2f0f4dea85ef522a10300a0e"
format_stamp: "Formatted at 2026-08-10 14:31:01 on dist-test-slave-0b58"
server_key: "c41fb4b3a52d033c9308273722061a10"
server_key_iv: "b91926f1a1f1040064e04c1e0340bed2"
server_key_version: "encryptionkey@0"
I20260810 14:31:01.134474 10133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:01.163132 10133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:01.166518 10133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:01.166688 10133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:01.168116 10133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:01.168175 10133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:01.168282 10133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:01.168318 10133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372261, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:31:01.179592 10133 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:45435
I20260810 14:31:01.180325 10267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:45435 every 8 connection(s)
I20260810 14:31:01.180831 10133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:31:01.183990 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 10133
I20260810 14:31:01.184123 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:31:01.184485 1849 external_mini_cluster.cc:1428] Setting key ee359e998f072916b9220d1d082c303a
I20260810 14:31:01.184512 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.169096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:46205 (local address 127.1.206.126:33539)
0810 14:31:01.169230 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.169233 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.170410 (+ 1177us) server_negotiation.cc:407] Connection header received
0810 14:31:01.171625 (+ 1215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.171630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.171703 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.171828 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:01.173427 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.174370 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.176444 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.176783 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.176908 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.180247 (+ 3339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:01.180251 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:01.180290 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:01.180332 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:01.182236 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.182866 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.182870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.182872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.182966 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.183316 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.183320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.183322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.183529 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:01.183638 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.184146 (+ 508us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.184333 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 14:31:01.185424 10157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.169697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33539 (local address 127.1.206.66:46205)
0810 14:31:01.170251 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.170297 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.171351 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.172076 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.172087 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.172609 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:01.173240 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.173256 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.174561 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.174564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.176311 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.176325 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.176980 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.176987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.177228 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.178122 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:01.178146 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:01.180029 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:01.182385 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.182394 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.182412 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.182751 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.183066 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.183069 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.183071 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.183216 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.183636 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:01.183645 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:01.183905 (+ 260us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.184103 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.184478 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":133,"threads_started":1}
I20260810 14:31:01.186847 10268 heartbeater.cc:347] Connected to a master server at 127.1.206.126:33539
I20260810 14:31:01.187012 10268 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:01.187651 10268 heartbeater.cc:511] Master 127.1.206.126:33539 requested a full tablet report, sending...
I20260810 14:31:01.189119 9905 ts_manager.cc:194] Registered new tserver with Master: 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:01.189955 9905 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:46205
WARNING: no policy specified for oryx/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:31:01.198729 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.189193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:54269 (local address 127.1.206.126:33539)
0810 14:31:01.189477 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.189483 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.189532 (+ 49us) server_negotiation.cc:407] Connection header received
0810 14:31:01.189671 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.189676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.189729 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.189817 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:01.192419 (+ 2602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.192960 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.193876 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.194100 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.194214 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.195444 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:01.195447 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:01.195449 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:01.195474 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:01.196955 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.197445 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.197449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.197450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.197535 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.197831 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.197836 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.197837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.198069 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:01.198183 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.198495 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.198607 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260810 14:31:01.198724 10275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.189113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33539 (local address 127.1.206.66:54269)
0810 14:31:01.189455 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.189472 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.189573 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.189851 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.189853 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.190078 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:01.190211 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.190221 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.193104 (+ 2883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.193106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.193752 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.193761 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.194220 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.194224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.194329 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.194943 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:01.194955 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:01.195294 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:01.197074 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.197077 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.197079 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.197341 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.197632 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.197635 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.197637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.197730 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.198172 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:01.198175 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:01.198280 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.198413 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.198555 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab.
Entry for principal oryx/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab.
I20260810 14:31:01.216082 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:33539
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab
--principal=oryx/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:44915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:01.333532 10278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:01.333828 10278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:01.333875 10278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:01.338155 10278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:01.338232 10278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:01.338308 10278 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:31:01.338388 10278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:31:01.344164 10278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab
--principal=oryx/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.206.126:33539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:01.345393 10278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:01.346474 10278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:01.356741 10283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:01.356709 10286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:01.356906 10278 server_base.cc:1034] running on GCE node
W20260810 14:31:01.357095 10284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:01.357518 10278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:01.358203 10278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:01.359397 10278 hybrid_clock.cc:648] HybridClock initialized: now 1786372261359361 us; error 45 us; skew 500 ppm
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372261, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:01.362846 10278 init.cc:377] Logged in from keytab as oryx/127.1.206.67@KRBTEST.COM (short username oryx)
I20260810 14:31:01.363960 10278 webserver.cc:460] Webserver started at http://127.1.206.67:45511/ using document root <none> and password file <none>
I20260810 14:31:01.364643 10278 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:01.364745 10278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:01.364992 10278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:01.367156 10278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "811c50df70be4eac91f20e299700b66a"
format_stamp: "Formatted at 2026-08-10 14:31:01 on dist-test-slave-0b58"
server_key: "c7902e7d6577349a3f30252b24e444d9"
server_key_iv: "1478cc24921a39e669e247ab4a744fd7"
server_key_version: "encryptionkey@0"
I20260810 14:31:01.367765 10278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "811c50df70be4eac91f20e299700b66a"
format_stamp: "Formatted at 2026-08-10 14:31:01 on dist-test-slave-0b58"
server_key: "c7902e7d6577349a3f30252b24e444d9"
server_key_iv: "1478cc24921a39e669e247ab4a744fd7"
server_key_version: "encryptionkey@0"
I20260810 14:31:01.371722 10278 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:31:01.374426 10294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:01.375679 10278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:01.375828 10278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "811c50df70be4eac91f20e299700b66a"
format_stamp: "Formatted at 2026-08-10 14:31:01 on dist-test-slave-0b58"
server_key: "c7902e7d6577349a3f30252b24e444d9"
server_key_iv: "1478cc24921a39e669e247ab4a744fd7"
server_key_version: "encryptionkey@0"
I20260810 14:31:01.375952 10278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:01.389153 10278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:01.392302 10278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:01.392517 10278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:01.394094 10278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:01.394172 10278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:01.394255 10278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:01.394297 10278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372261, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:31:01.405393 10278 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:33079
I20260810 14:31:01.405417 10418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:33079 every 8 connection(s)
I20260810 14:31:01.406368 10278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:31:01.408912 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.394937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:59673 (local address 127.1.206.126:33539)
0810 14:31:01.395092 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.395097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.396029 (+ 932us) server_negotiation.cc:407] Connection header received
0810 14:31:01.397255 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.397261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.397337 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.397448 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:01.399114 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.400050 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.401405 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.401832 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.401973 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.404813 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:01.404822 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:01.404825 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:01.404875 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:01.406610 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.407237 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.407241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.407243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.407345 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.407725 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.407728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.407730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.407931 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:01.408041 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.408610 (+ 569us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.408741 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:31:01.409682 10303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.395371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33539 (local address 127.1.206.67:59673)
0810 14:31:01.395850 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.395901 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.396981 (+ 1080us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.397639 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.397650 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.398166 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:01.398947 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.398971 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.400194 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.400200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.401292 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.401302 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.402020 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.402024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.402178 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.402829 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:01.402846 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:01.404625 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:01.406736 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.406742 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.406757 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.407133 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.407451 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.407454 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.407456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.407600 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.408039 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:01.408045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:01.408361 (+ 316us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.408549 (+ 188us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.408886 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":141,"threads_started":1}
I20260810 14:31:01.411041 10419 heartbeater.cc:347] Connected to a master server at 127.1.206.126:33539
I20260810 14:31:01.411211 10419 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:01.411849 10419 heartbeater.cc:511] Master 127.1.206.126:33539 requested a full tablet report, sending...
I20260810 14:31:01.413303 9905 ts_manager.cc:194] Registered new tserver with Master: 811c50df70be4eac91f20e299700b66a (127.1.206.67:33079)
I20260810 14:31:01.414072 9905 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:59673
I20260810 14:31:01.414574 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 10278
I20260810 14:31:01.414721 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:31:01.415040 1849 external_mini_cluster.cc:1428] Setting key edba04574f5d1eb0151a0f010ece6ef3
I20260810 14:31:01.417325 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:31:01.422715 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.413375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:46159 (local address 127.1.206.126:33539)
0810 14:31:01.413486 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.413490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.413675 (+ 185us) server_negotiation.cc:407] Connection header received
0810 14:31:01.413770 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.413773 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.413819 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.413893 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:01.415483 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.416138 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.417334 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.417615 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.417699 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.419056 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:01.419059 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:01.419062 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:01.419085 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:01.420888 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.421410 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.421413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.421415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.421508 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.421874 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.421877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.421878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.422061 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:01.422139 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.422473 (+ 334us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.422587 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 14:31:01.422935 10425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.413298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33539 (local address 127.1.206.67:46159)
0810 14:31:01.413571 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.413587 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.413676 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.413930 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.413932 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.414093 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:01.415357 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.415368 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.416343 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.416347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.417187 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.417198 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.417730 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.417734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.417858 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.418383 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:01.418403 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:01.418913 (+ 510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:01.421056 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.421059 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.421060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.421297 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.421636 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.421642 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.421646 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.421777 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.422159 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:01.422165 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:01.422290 (+ 125us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.422412 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.422608 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":112,"threads_started":1}
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372261, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:31:01.446095 9957 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:01.439592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49724 (local address 127.1.206.126:33539)
0810 14:31:01.439725 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.439728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.439743 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:31:01.439788 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.439791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.439836 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.439909 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:01.440750 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.441271 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.442120 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.442390 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.442474 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.445899 (+ 3425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49724: BlockingRecv error: recv got EOF from 127.0.0.1:49724 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372261, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:31:01.456662 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.447743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49728 (local address 127.1.206.126:33539)
0810 14:31:01.447889 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.447893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.448115 (+ 222us) server_negotiation.cc:407] Connection header received
0810 14:31:01.448344 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.448347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.448395 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.448473 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:01.449080 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.449620 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.450420 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.450634 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.450718 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.453295 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:01.453299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:01.453301 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:01.453331 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:01.454877 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.455356 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.455359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.455360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.455441 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.455729 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.455732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.455734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.455937 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:01.456085 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.456358 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.456486 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:31:01.459630 9905 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:31:01.463086 9905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:31:01.478652 10441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.471824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:44297 (local address 127.0.0.1:58206)
0810 14:31:01.472633 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.472689 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.472912 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.473748 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.473754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.473781 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:01.473943 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.473951 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.475614 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.475617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.476951 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.476963 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.478002 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.478006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.478129 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.478176 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.478321 (+ 145us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.478472 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":72,"thread_start_us":104,"threads_started":1}
I20260810 14:31:01.478652 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.472026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58206 (local address 127.1.206.65:44297)
0810 14:31:01.472373 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.472381 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.472782 (+ 401us) server_negotiation.cc:407] Connection header received
0810 14:31:01.473116 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.473125 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.473383 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.473523 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:01.474079 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.475280 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.477099 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.477852 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.477981 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.478159 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.478367 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.478500 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":126,"threads_started":1}
I20260810 14:31:01.479212 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.472027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:33079 (local address 127.0.0.1:41900)
0810 14:31:01.473464 (+ 1437us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.473479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.473559 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.474179 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.474182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.474202 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:01.474288 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.474294 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.475649 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.475652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.477422 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.477434 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.478552 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.478556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.478648 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.478684 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.478740 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.478818 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1356,"mutex_wait_us":371,"thread_start_us":94,"threads_started":1}
I20260810 14:31:01.479190 10442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.472662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:45435 (local address 127.0.0.1:51492)
0810 14:31:01.473760 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.473774 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.473870 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.474398 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.474401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.474418 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:01.474514 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.474520 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.475564 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.475571 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.477423 (+ 1852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.477434 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.478665 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.478671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.478781 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.478831 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.478906 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.478974 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"mutex_wait_us":389,"thread_start_us":105,"threads_started":1}
I20260810 14:31:01.479935 10445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.472852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51492 (local address 127.1.206.66:45435)
0810 14:31:01.473337 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.473351 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.473959 (+ 608us) server_negotiation.cc:407] Connection header received
0810 14:31:01.474047 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.474055 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.474239 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.474399 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:01.474638 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.475432 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.477602 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.478346 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.478445 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.478598 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.479315 (+ 717us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.479753 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":125,"threads_started":1}
I20260810 14:31:01.479981 10446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.473052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41900 (local address 127.1.206.67:33079)
0810 14:31:01.473562 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.473571 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.473591 (+ 20us) server_negotiation.cc:407] Connection header received
0810 14:31:01.473656 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.473659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.473977 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.474180 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:01.474440 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.475526 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.477578 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.478401 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.479528 (+ 1127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.479692 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.479741 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.479831 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":119,"threads_started":1}
I20260810 14:31:01.482445 10348 tablet_service.cc:1467] Processing CreateTablet for tablet 91acc63e2ec440dc896121e613a1403a (DEFAULT_TABLE table=test-table [id=ab0ce8f3ecca4e1681a49b444f44e471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:01.482503 10200 tablet_service.cc:1467] Processing CreateTablet for tablet 91acc63e2ec440dc896121e613a1403a (DEFAULT_TABLE table=test-table [id=ab0ce8f3ecca4e1681a49b444f44e471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:01.482489 10051 tablet_service.cc:1467] Processing CreateTablet for tablet 91acc63e2ec440dc896121e613a1403a (DEFAULT_TABLE table=test-table [id=ab0ce8f3ecca4e1681a49b444f44e471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:01.483491 10348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91acc63e2ec440dc896121e613a1403a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.483518 10200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91acc63e2ec440dc896121e613a1403a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.483518 10051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91acc63e2ec440dc896121e613a1403a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.490513 10447 tablet_bootstrap.cc:492] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Bootstrap starting.
I20260810 14:31:01.491417 10448 tablet_bootstrap.cc:492] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Bootstrap starting.
I20260810 14:31:01.492614 10449 tablet_bootstrap.cc:492] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Bootstrap starting.
I20260810 14:31:01.493659 10448 tablet_bootstrap.cc:654] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.493863 10447 tablet_bootstrap.cc:654] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.494542 10447 log.cc:824] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:01.494572 10449 tablet_bootstrap.cc:654] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.494562 10448 log.cc:824] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:01.495283 10449 log.cc:824] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:01.496634 10447 tablet_bootstrap.cc:492] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: No bootstrap required, opened a new log
I20260810 14:31:01.496662 10448 tablet_bootstrap.cc:492] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: No bootstrap required, opened a new log
I20260810 14:31:01.496850 10447 ts_tablet_manager.cc:1397] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 14:31:01.496847 10448 ts_tablet_manager.cc:1397] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:31:01.497308 10449 tablet_bootstrap.cc:492] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: No bootstrap required, opened a new log
I20260810 14:31:01.497480 10449 ts_tablet_manager.cc:1397] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 14:31:01.500602 10447 raft_consensus.cc:348] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.500914 10447 raft_consensus.cc:374] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.501044 10447 raft_consensus.cc:729] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.501477 10448 raft_consensus.cc:348] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.501786 10448 raft_consensus.cc:374] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.501843 10448 raft_consensus.cc:729] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aaa0714476444db96d0b00543f2a323, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.501837 10447 consensus_queue.cc:260] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.501967 10449 raft_consensus.cc:348] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.502305 10449 raft_consensus.cc:374] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.502388 10449 raft_consensus.cc:729] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21875d1c2f0f4dea85ef522a10300a0e, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.502390 10448 consensus_queue.cc:260] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.502964 10449 consensus_queue.cc:260] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.503851 10447 ts_tablet_manager.cc:1428] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 14:31:01.504483 10419 heartbeater.cc:503] Master 127.1.206.126:33539 was elected leader, sending a full tablet report...
I20260810 14:31:01.505324 10448 ts_tablet_manager.cc:1428] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 14:31:01.505653 10122 heartbeater.cc:503] Master 127.1.206.126:33539 was elected leader, sending a full tablet report...
I20260810 14:31:01.505764 10449 ts_tablet_manager.cc:1428] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 14:31:01.506111 10268 heartbeater.cc:503] Master 127.1.206.126:33539 was elected leader, sending a full tablet report...
W20260810 14:31:01.657449 10420 tablet.cc:2369] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:31:01.682467 10269 tablet.cc:2369] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:31:01.689146 10123 tablet.cc:2369] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:31:01.740506 10453 raft_consensus.cc:482] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:31:01.740746 10453 raft_consensus.cc:504] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.741974 10453 leader_election.cc:288] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:01.746912 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.742416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:56127 (local address 127.1.206.65:44297)
0810 14:31:01.742568 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.742573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.742621 (+ 48us) server_negotiation.cc:407] Connection header received
0810 14:31:01.742822 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.742825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.742893 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.742980 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:01.743335 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.744234 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.745594 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.746255 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.746393 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.746460 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.746682 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.746809 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:31:01.746910 10303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.742313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:44297 (local address 127.1.206.67:56127)
0810 14:31:01.742551 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.742568 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.742684 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.743015 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.743018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.743040 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:01.743185 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.743192 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.744358 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.744362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.745466 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.745475 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.746410 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.746414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.746527 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.746555 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.746655 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.746758 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":20}
I20260810 14:31:01.747714 10456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.742319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:45435 (local address 127.1.206.67:43501)
0810 14:31:01.742842 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.742857 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.742986 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.743359 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.743362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.743381 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:01.743967 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.743976 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.745138 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.745140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.746204 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.746217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.747265 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.747268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.747391 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.747415 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.747496 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.747579 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":33,"thread_start_us":140,"threads_started":1}
I20260810 14:31:01.747776 10445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.742416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:43501 (local address 127.1.206.66:45435)
0810 14:31:01.742568 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.742573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.743008 (+ 435us) server_negotiation.cc:407] Connection header received
0810 14:31:01.743190 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.743193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.743254 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.743343 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:01.744208 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.745010 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.746392 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.747022 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.747148 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.747185 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.747565 (+ 380us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.747663 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 14:31:01.747886 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91acc63e2ec440dc896121e613a1403a" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323" is_pre_election: true
I20260810 14:31:01.748332 10068 raft_consensus.cc:2454] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:01.748407 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91acc63e2ec440dc896121e613a1403a" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e" is_pre_election: true
I20260810 14:31:01.748739 10220 raft_consensus.cc:2454] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:01.748950 10298 leader_election.cc:302] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aaa0714476444db96d0b00543f2a323, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:01.749279 10453 raft_consensus.cc:2781] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:31:01.749382 10453 raft_consensus.cc:482] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:31:01.749426 10453 raft_consensus.cc:3037] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:01.750535 10453 raft_consensus.cc:504] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.750921 10453 leader_election.cc:288] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Requested vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:01.751336 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91acc63e2ec440dc896121e613a1403a" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323"
I20260810 14:31:01.751358 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91acc63e2ec440dc896121e613a1403a" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e"
I20260810 14:31:01.751462 10068 raft_consensus.cc:3037] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:01.751509 10220 raft_consensus.cc:3037] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:01.752717 10068 raft_consensus.cc:2454] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:01.752732 10220 raft_consensus.cc:2454] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:01.753093 10298 leader_election.cc:302] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aaa0714476444db96d0b00543f2a323, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:01.753417 10453 raft_consensus.cc:2781] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:01.753655 10453 raft_consensus.cc:686] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Becoming Leader. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Running, Role: LEADER
I20260810 14:31:01.754030 10453 consensus_queue.cc:237] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } }
I20260810 14:31:01.757478 9903 catalog_manager.cc:5495] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a reported cstate change: term changed from 0 to 1, leader changed from <none> to 811c50df70be4eac91f20e299700b66a (127.1.206.67). New cstate: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } health_report { overall_health: UNKNOWN } } }
I20260810 14:31:01.779191 10446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.775441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41912 (local address 127.1.206.67:33079)
0810 14:31:01.775577 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.775581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.775597 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:31:01.775729 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.775731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.775788 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.775878 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:31:01.776128 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.776724 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.777624 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.777912 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.777999 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.778278 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:31:01.778763 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:31:01.778900 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.778961 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.779015 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:31:01.785526 10068 raft_consensus.cc:1261] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:01.785526 10220 raft_consensus.cc:1261] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:01.786289 10453 consensus_queue.cc:1035] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:01.786535 10457 consensus_queue.cc:1035] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:01.793604 10460 mvcc.cc:205] Tried to move back new op lower bound from 7316980784264859648 to 7316980784147361792. Current Snapshot: MvccSnapshot[applied={T|T < 7316980784264859648}]
I20260810 14:31:01.796547 10462 mvcc.cc:205] Tried to move back new op lower bound from 7316980784264859648 to 7316980784147361792. Current Snapshot: MvccSnapshot[applied={T|T < 7316980784264859648}]
I20260810 14:31:01.797578 10461 mvcc.cc:205] Tried to move back new op lower bound from 7316980784264859648 to 7316980784147361792. Current Snapshot: MvccSnapshot[applied={T|T < 7316980784264859648}]
I20260810 14:31:01.802341 9903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:01.802568 9903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:01.805265 9903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Sending DeleteTablet for 3 replicas of tablet 91acc63e2ec440dc896121e613a1403a
I20260810 14:31:01.806304 10051 tablet_service.cc:1514] Processing DeleteTablet for tablet 91acc63e2ec440dc896121e613a1403a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:01 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:58206
I20260810 14:31:01.806542 10348 tablet_service.cc:1514] Processing DeleteTablet for tablet 91acc63e2ec440dc896121e613a1403a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:01 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:41900
I20260810 14:31:01.807102 10473 tablet_replica.cc:330] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: stopping tablet replica
I20260810 14:31:01.807062 10200 tablet_service.cc:1514] Processing DeleteTablet for tablet 91acc63e2ec440dc896121e613a1403a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:01 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:51492
I20260810 14:31:01.807037 9903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:31:01.807536 9903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:31:01.807715 10473 raft_consensus.cc:2229] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:01.808158 10473 raft_consensus.cc:2258] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:01.808667 10474 tablet_replica.cc:330] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: stopping tablet replica
I20260810 14:31:01.809029 10474 raft_consensus.cc:2229] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:31:01.809442 10474 raft_consensus.cc:2258] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:01.809906 10475 tablet_replica.cc:330] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: stopping tablet replica
I20260810 14:31:01.810012 10473 ts_tablet_manager.cc:1905] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:01.810220 10475 raft_consensus.cc:2229] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:01.811337 10474 ts_tablet_manager.cc:1905] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:01.811317 10475 raft_consensus.cc:2258] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:01.813879 10473 ts_tablet_manager.cc:1918] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:01.814010 10473 log.cc:1196] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/91acc63e2ec440dc896121e613a1403a
I20260810 14:31:01.815050 10051 tablet_service.cc:1467] Processing CreateTablet for tablet e60cefa809d9427cb99ea6ba7ec41ca2 (DEFAULT_TABLE table=test-table [id=39ad912016184947ad171a68a610c85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:01.815320 10200 tablet_service.cc:1467] Processing CreateTablet for tablet e60cefa809d9427cb99ea6ba7ec41ca2 (DEFAULT_TABLE table=test-table [id=39ad912016184947ad171a68a610c85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:01.815430 10051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e60cefa809d9427cb99ea6ba7ec41ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.815709 10200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e60cefa809d9427cb99ea6ba7ec41ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.815876 10474 ts_tablet_manager.cc:1918] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:01.815989 10474 log.cc:1196] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/91acc63e2ec440dc896121e613a1403a
I20260810 14:31:01.816370 10474 ts_tablet_manager.cc:1939] T 91acc63e2ec440dc896121e613a1403a P 811c50df70be4eac91f20e299700b66a: Deleting consensus metadata
I20260810 14:31:01.816815 10348 tablet_service.cc:1467] Processing CreateTablet for tablet e60cefa809d9427cb99ea6ba7ec41ca2 (DEFAULT_TABLE table=test-table [id=39ad912016184947ad171a68a610c85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:01.817097 10348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e60cefa809d9427cb99ea6ba7ec41ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.817945 10448 tablet_bootstrap.cc:492] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: Bootstrap starting.
I20260810 14:31:01.818400 10449 tablet_bootstrap.cc:492] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: Bootstrap starting.
I20260810 14:31:01.819015 10448 tablet_bootstrap.cc:654] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.819415 10449 tablet_bootstrap.cc:654] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.820823 10447 tablet_bootstrap.cc:492] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: Bootstrap starting.
I20260810 14:31:01.821101 10448 tablet_bootstrap.cc:492] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: No bootstrap required, opened a new log
I20260810 14:31:01.821204 10448 ts_tablet_manager.cc:1397] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:01.821211 10475 ts_tablet_manager.cc:1905] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:01.821918 10447 tablet_bootstrap.cc:654] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.822149 10448 raft_consensus.cc:348] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.822311 10448 raft_consensus.cc:374] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.822362 10448 raft_consensus.cc:729] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aaa0714476444db96d0b00543f2a323, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.822558 10448 consensus_queue.cc:260] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.824482 10473 ts_tablet_manager.cc:1939] T 91acc63e2ec440dc896121e613a1403a P 0aaa0714476444db96d0b00543f2a323: Deleting consensus metadata
I20260810 14:31:01.824540 10448 ts_tablet_manager.cc:1428] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:01.825155 10475 ts_tablet_manager.cc:1918] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:01.825292 10475 log.cc:1196] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/91acc63e2ec440dc896121e613a1403a
I20260810 14:31:01.825541 10449 tablet_bootstrap.cc:492] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: No bootstrap required, opened a new log
I20260810 14:31:01.825644 10475 ts_tablet_manager.cc:1939] T 91acc63e2ec440dc896121e613a1403a P 21875d1c2f0f4dea85ef522a10300a0e: Deleting consensus metadata
I20260810 14:31:01.825651 10449 ts_tablet_manager.cc:1397] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 14:31:01.827153 9890 catalog_manager.cc:4841] TS 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297): tablet 91acc63e2ec440dc896121e613a1403a (table test-table [id=ab0ce8f3ecca4e1681a49b444f44e471]) successfully deleted
I20260810 14:31:01.827293 10449 raft_consensus.cc:348] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.827402 9888 catalog_manager.cc:4841] TS 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435): tablet 91acc63e2ec440dc896121e613a1403a (table test-table [id=ab0ce8f3ecca4e1681a49b444f44e471]) successfully deleted
I20260810 14:31:01.827437 10449 raft_consensus.cc:374] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.827477 10449 raft_consensus.cc:729] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21875d1c2f0f4dea85ef522a10300a0e, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.827605 10449 consensus_queue.cc:260] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.827904 10449 ts_tablet_manager.cc:1428] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:31:01.827991 9888 catalog_manager.cc:4841] TS 811c50df70be4eac91f20e299700b66a (127.1.206.67:33079): tablet 91acc63e2ec440dc896121e613a1403a (table test-table [id=ab0ce8f3ecca4e1681a49b444f44e471]) successfully deleted
I20260810 14:31:01.828814 10447 tablet_bootstrap.cc:492] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: No bootstrap required, opened a new log
I20260810 14:31:01.828913 10447 ts_tablet_manager.cc:1397] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260810 14:31:01.829418 10447 raft_consensus.cc:348] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.829548 10447 raft_consensus.cc:374] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.829587 10447 raft_consensus.cc:729] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.829707 10447 consensus_queue.cc:260] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.829967 10447 ts_tablet_manager.cc:1428] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:31:01.915531 10469 raft_consensus.cc:482] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:31:01.915712 10469 raft_consensus.cc:504] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.916286 10469 leader_election.cc:288] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:01.916780 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e60cefa809d9427cb99ea6ba7ec41ca2" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323" is_pre_election: true
I20260810 14:31:01.916831 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e60cefa809d9427cb99ea6ba7ec41ca2" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e" is_pre_election: true
I20260810 14:31:01.916967 10220 raft_consensus.cc:2454] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:01.916968 10068 raft_consensus.cc:2454] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:01.917346 10298 leader_election.cc:302] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aaa0714476444db96d0b00543f2a323, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:01.917537 10469 raft_consensus.cc:2781] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:31:01.917599 10469 raft_consensus.cc:482] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:31:01.917639 10469 raft_consensus.cc:3037] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:01.918701 10469 raft_consensus.cc:504] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.919121 10469 leader_election.cc:288] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Requested vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:01.919560 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e60cefa809d9427cb99ea6ba7ec41ca2" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e"
I20260810 14:31:01.919550 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e60cefa809d9427cb99ea6ba7ec41ca2" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323"
I20260810 14:31:01.919693 10068 raft_consensus.cc:3037] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:01.919718 10220 raft_consensus.cc:3037] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:01.920790 10220 raft_consensus.cc:2454] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:01.921031 10068 raft_consensus.cc:2454] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:01.921129 10296 leader_election.cc:302] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21875d1c2f0f4dea85ef522a10300a0e, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:01.921514 10469 raft_consensus.cc:2781] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:01.921641 10469 raft_consensus.cc:686] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Becoming Leader. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Running, Role: LEADER
I20260810 14:31:01.921806 10469 consensus_queue.cc:237] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.923776 9902 catalog_manager.cc:5495] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a reported cstate change: term changed from 0 to 1, leader changed from <none> to 811c50df70be4eac91f20e299700b66a (127.1.206.67). New cstate: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } health_report { overall_health: HEALTHY } } }
Aug 10 14:31:01 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372260, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.126@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:31:01.983479 10485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.974146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:33539 (local address 127.0.0.1:49732)
0810 14:31:01.974477 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:01.974498 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:01.974600 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:01.974939 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:01.974941 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:01.975367 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:01.975478 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.975485 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.976445 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.976448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.977030 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:01.977039 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.977559 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.977562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:01.977656 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.978331 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:01.978344 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:01.980068 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:01.981947 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.981956 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.981962 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.982265 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.982526 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:01.982528 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:01.982529 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:01.982611 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:01.982975 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:01.982981 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:01.983087 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 14:31:01.983181 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 14:31:01.983315 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":136,"threads_started":1}
I20260810 14:31:01.983513 10486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:01.974229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.1.206.126:33539)
0810 14:31:01.974530 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:01.974539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:01.974557 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:31:01.974707 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:01.974711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:01.974773 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:01.974888 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:01.975623 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.976175 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.977174 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:01.977412 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:01.977511 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:01.980202 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:01.980205 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:01.980207 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:01.980229 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:01.981848 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.982365 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.982367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.982368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.982446 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:01.982687 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:01.982689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:01.982690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:01.982885 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:01.982961 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:01.983243 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 14:31:01.983379 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":232,"thread_start_us":119,"threads_started":1}
I20260810 14:31:01.987764 9902 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:49732:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 14:31:01.988579 9902 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:31:01.993600 10051 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1b909b47e5497d90985474068f57c6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c6a2be47e5f440ac9af34049c8fcaefc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:31:01.993752 10200 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1b909b47e5497d90985474068f57c6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c6a2be47e5f440ac9af34049c8fcaefc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:31:01.993752 10348 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1b909b47e5497d90985474068f57c6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c6a2be47e5f440ac9af34049c8fcaefc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:31:01.994027 10051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1b909b47e5497d90985474068f57c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.994136 10348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1b909b47e5497d90985474068f57c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.994136 10200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1b909b47e5497d90985474068f57c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:01.996547 10448 tablet_bootstrap.cc:492] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: Bootstrap starting.
I20260810 14:31:01.996907 10447 tablet_bootstrap.cc:492] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: Bootstrap starting.
I20260810 14:31:01.997012 10449 tablet_bootstrap.cc:492] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: Bootstrap starting.
I20260810 14:31:01.997536 10448 tablet_bootstrap.cc:654] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.997596 10447 tablet_bootstrap.cc:654] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.998024 10449 tablet_bootstrap.cc:654] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:01.998847 10447 tablet_bootstrap.cc:492] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: No bootstrap required, opened a new log
I20260810 14:31:01.998942 10447 ts_tablet_manager.cc:1397] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:31:01.999150 10448 tablet_bootstrap.cc:492] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: No bootstrap required, opened a new log
I20260810 14:31:01.999246 10448 ts_tablet_manager.cc:1397] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:01.999300 10449 tablet_bootstrap.cc:492] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: No bootstrap required, opened a new log
I20260810 14:31:01.999400 10449 ts_tablet_manager.cc:1397] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:01.999369 10447 raft_consensus.cc:348] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.999500 10447 raft_consensus.cc:374] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.999543 10447 raft_consensus.cc:729] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.999681 10447 consensus_queue.cc:260] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.999696 10448 raft_consensus.cc:348] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.999805 10448 raft_consensus.cc:374] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.999864 10448 raft_consensus.cc:729] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aaa0714476444db96d0b00543f2a323, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.999801 10449 raft_consensus.cc:348] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:01.999913 10449 raft_consensus.cc:374] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:01.999954 10449 raft_consensus.cc:729] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21875d1c2f0f4dea85ef522a10300a0e, State: Initialized, Role: FOLLOWER
I20260810 14:31:01.999994 10447 ts_tablet_manager.cc:1428] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:31:02.000001 10448 consensus_queue.cc:260] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.000065 10449 consensus_queue.cc:260] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.000198 10457 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.000321 10448 ts_tablet_manager.cc:1428] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 14:31:02.000331 10449 ts_tablet_manager.cc:1428] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:31:02.000371 10457 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:31:02.000537 10454 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.000676 10454 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:31:02.001240 10455 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.001398 10455 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:31:02.012038 10457 raft_consensus.cc:482] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:31:02.012192 10457 raft_consensus.cc:504] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.012705 10457 leader_election.cc:288] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:02.013147 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1b909b47e5497d90985474068f57c6" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e" is_pre_election: true
I20260810 14:31:02.013149 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1b909b47e5497d90985474068f57c6" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323" is_pre_election: true
I20260810 14:31:02.013298 10220 raft_consensus.cc:2454] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:02.013298 10068 raft_consensus.cc:2454] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:02.013738 10298 leader_election.cc:302] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aaa0714476444db96d0b00543f2a323, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:02.014003 10457 raft_consensus.cc:2781] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:31:02.014070 10457 raft_consensus.cc:482] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:31:02.014113 10457 raft_consensus.cc:3037] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.015128 10457 raft_consensus.cc:504] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.015468 10457 leader_election.cc:288] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Requested vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:02.015844 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1b909b47e5497d90985474068f57c6" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e"
I20260810 14:31:02.015861 10068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1b909b47e5497d90985474068f57c6" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323"
I20260810 14:31:02.015957 10220 raft_consensus.cc:3037] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.016029 10068 raft_consensus.cc:3037] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.016949 10220 raft_consensus.cc:2454] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:02.017059 10068 raft_consensus.cc:2454] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:02.017316 10296 leader_election.cc:302] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21875d1c2f0f4dea85ef522a10300a0e, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:02.017500 10457 raft_consensus.cc:2781] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:02.017599 10457 raft_consensus.cc:686] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Becoming Leader. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Running, Role: LEADER
I20260810 14:31:02.017762 10457 consensus_queue.cc:237] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.018492 10469 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: TxnStatusTablet state changed. Reason: New leader 811c50df70be4eac91f20e299700b66a. Latest consensus state: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.018599 10469 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:31:02.018903 10492 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 14:31:02.019100 10492 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 14:31:02.019605 9900 catalog_manager.cc:5495] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a reported cstate change: term changed from 0 to 1, leader changed from <none> to 811c50df70be4eac91f20e299700b66a (127.1.206.67). New cstate: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } health_report { overall_health: HEALTHY } } }
I20260810 14:31:02.033869 10485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.029989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:33079 (local address 127.0.0.1:41916)
0810 14:31:02.030147 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:02.030166 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:02.030271 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:02.030580 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:02.030582 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:02.030588 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:31:02.030686 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.030690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.031756 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.031758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.032508 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.032520 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.033143 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.033145 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.033220 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.033274 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:31:02.033589 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:31:02.033601 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 14:31:02.033653 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:31:02.033735 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 14:31:02.033888 10446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.030095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41916 (local address 127.1.206.67:33079)
0810 14:31:02.030227 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:02.030232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:02.030249 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:31:02.030404 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:02.030408 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:02.030466 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:02.030553 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:31:02.030832 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.031641 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.032655 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.033013 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.033125 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.033414 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:31:02.033502 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:31:02.033577 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:02.033688 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 14:31:02.033748 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 14:31:02.036733 10068 raft_consensus.cc:1261] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.036733 10220 raft_consensus.cc:1261] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.037195 10457 consensus_queue.cc:1035] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.037348 10469 consensus_queue.cc:1035] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.038937 10455 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: TxnStatusTablet state changed. Reason: New leader 811c50df70be4eac91f20e299700b66a. Latest consensus state: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.039073 10455 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:31:02.039781 10454 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: TxnStatusTablet state changed. Reason: New leader 811c50df70be4eac91f20e299700b66a. Latest consensus state: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.039923 10454 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:31:02.041471 10457 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.041613 10457 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:31:02.041673 10453 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.041751 10453 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 811c50df70be4eac91f20e299700b66a: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:31:02.043422 10454 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.043543 10454 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 0aaa0714476444db96d0b00543f2a323: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:31:02.046316 10455 tablet_replica.cc:439] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } } }
I20260810 14:31:02.046446 10455 tablet_replica.cc:442] T 0a1b909b47e5497d90985474068f57c6 P 21875d1c2f0f4dea85ef522a10300a0e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:31:02.057966 10446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.053895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:58965 (local address 127.1.206.67:33079)
0810 14:31:02.054037 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:02.054042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:02.054229 (+ 187us) server_negotiation.cc:407] Connection header received
0810 14:31:02.054327 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:02.054330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:02.054382 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:02.054468 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:31:02.054679 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.055446 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.056728 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.056949 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.057036 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.057409 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:31:02.057518 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:31:02.057602 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:02.057771 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 14:31:02.057820 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:31:02.058012 10499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.053781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:33079 (local address 127.1.206.67:58965)
0810 14:31:02.054143 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:02.054156 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:02.054253 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:02.054484 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:02.054486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:02.054492 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:31:02.054579 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.054583 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.055587 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.055590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.056596 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.056616 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.057075 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.057079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.057173 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.057235 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:31:02.057640 (+ 405us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:31:02.057648 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:31:02.057722 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:31:02.057814 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":146,"threads_started":1}
I20260810 14:31:02.065405 10068 raft_consensus.cc:1261] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.065567 10220 raft_consensus.cc:1261] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.065886 10469 consensus_queue.cc:1035] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.066037 10453 consensus_queue.cc:1035] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.107338 9900 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:02.107499 9900 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:02.109724 9900 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Sending DeleteTablet for 3 replicas of tablet e60cefa809d9427cb99ea6ba7ec41ca2
I20260810 14:31:02.110424 10051 tablet_service.cc:1514] Processing DeleteTablet for tablet e60cefa809d9427cb99ea6ba7ec41ca2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:58206
I20260810 14:31:02.110515 10200 tablet_service.cc:1514] Processing DeleteTablet for tablet e60cefa809d9427cb99ea6ba7ec41ca2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:51492
I20260810 14:31:02.110762 10473 tablet_replica.cc:330] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: stopping tablet replica
I20260810 14:31:02.110918 10473 raft_consensus.cc:2229] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:02.111084 10473 raft_consensus.cc:2258] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.111302 10475 tablet_replica.cc:330] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: stopping tablet replica
I20260810 14:31:02.111460 10475 raft_consensus.cc:2229] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:02.111589 10475 raft_consensus.cc:2258] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.113196 10473 ts_tablet_manager.cc:1905] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.114821 10348 tablet_service.cc:1514] Processing DeleteTablet for tablet e60cefa809d9427cb99ea6ba7ec41ca2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:41900
I20260810 14:31:02.115017 10474 tablet_replica.cc:330] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: stopping tablet replica
I20260810 14:31:02.115157 10474 raft_consensus.cc:2229] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:31:02.115353 10474 raft_consensus.cc:2258] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.116010 10474 ts_tablet_manager.cc:1905] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.116230 10473 ts_tablet_manager.cc:1918] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:31:02.116343 10473 log.cc:1196] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/e60cefa809d9427cb99ea6ba7ec41ca2
I20260810 14:31:02.116632 10473 ts_tablet_manager.cc:1939] T e60cefa809d9427cb99ea6ba7ec41ca2 P 0aaa0714476444db96d0b00543f2a323: Deleting consensus metadata
I20260810 14:31:02.117434 9890 catalog_manager.cc:4841] TS 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297): tablet e60cefa809d9427cb99ea6ba7ec41ca2 (table test-table [id=39ad912016184947ad171a68a610c85e]) successfully deleted
I20260810 14:31:02.118348 10474 ts_tablet_manager.cc:1918] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:31:02.118417 10474 log.cc:1196] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/e60cefa809d9427cb99ea6ba7ec41ca2
I20260810 14:31:02.118669 10474 ts_tablet_manager.cc:1939] T e60cefa809d9427cb99ea6ba7ec41ca2 P 811c50df70be4eac91f20e299700b66a: Deleting consensus metadata
I20260810 14:31:02.119335 9888 catalog_manager.cc:4841] TS 811c50df70be4eac91f20e299700b66a (127.1.206.67:33079): tablet e60cefa809d9427cb99ea6ba7ec41ca2 (table test-table [id=39ad912016184947ad171a68a610c85e]) successfully deleted
I20260810 14:31:02.119968 10475 ts_tablet_manager.cc:1905] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.122789 10475 ts_tablet_manager.cc:1918] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:31:02.122879 10475 log.cc:1196] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/e60cefa809d9427cb99ea6ba7ec41ca2
I20260810 14:31:02.123144 10475 ts_tablet_manager.cc:1939] T e60cefa809d9427cb99ea6ba7ec41ca2 P 21875d1c2f0f4dea85ef522a10300a0e: Deleting consensus metadata
I20260810 14:31:02.123935 9888 catalog_manager.cc:4841] TS 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435): tablet e60cefa809d9427cb99ea6ba7ec41ca2 (table test-table [id=39ad912016184947ad171a68a610c85e]) successfully deleted
Aug 10 14:31:02 dist-test-slave-0b58 krb5kdc[9858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:31:02 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:02 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:31:02.146198 10486 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:02.138117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49740 (local address 127.1.206.126:33539)
0810 14:31:02.138273 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:02.138278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:02.138477 (+ 199us) server_negotiation.cc:407] Connection header received
0810 14:31:02.138593 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:02.138596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:02.138661 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:02.138760 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:02.139751 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.140666 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.141855 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.142204 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.142321 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.146042 (+ 3721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49740: BlockingRecv error: recv got EOF from 127.0.0.1:49740 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 14:31:02 dist-test-slave-0b58 krb5kdc[9858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM
I20260810 14:31:02.157724 10486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.147713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49752 (local address 127.1.206.126:33539)
0810 14:31:02.147870 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:02.147874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:02.148225 (+ 351us) server_negotiation.cc:407] Connection header received
0810 14:31:02.148390 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:02.148392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:02.148441 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:02.148510 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:02.149301 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.149857 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.151005 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.151286 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.151372 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.154215 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:02.154219 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:02.154221 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:02.154248 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:02.155815 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:02.156293 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:02.156299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:02.156304 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:02.156406 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:02.156695 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:02.156699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:02.156700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:02.156902 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:02.157055 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:02.157297 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 14:31:02.157542 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:31:02.161067 9900 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:31:02.161643 9900 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:31:02.166751 10051 tablet_service.cc:1467] Processing CreateTablet for tablet 9348adc8bbda4f4988ddfbc6e5232ef9 (DEFAULT_TABLE table=test-table [id=cf5d88ae93bf4021bd1a8a608c8c1250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:02.166890 10348 tablet_service.cc:1467] Processing CreateTablet for tablet 9348adc8bbda4f4988ddfbc6e5232ef9 (DEFAULT_TABLE table=test-table [id=cf5d88ae93bf4021bd1a8a608c8c1250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:02.166890 10200 tablet_service.cc:1467] Processing CreateTablet for tablet 9348adc8bbda4f4988ddfbc6e5232ef9 (DEFAULT_TABLE table=test-table [id=cf5d88ae93bf4021bd1a8a608c8c1250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:02.167088 10051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9348adc8bbda4f4988ddfbc6e5232ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:02.167186 10348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9348adc8bbda4f4988ddfbc6e5232ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:02.167186 10200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9348adc8bbda4f4988ddfbc6e5232ef9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:02.169588 10448 tablet_bootstrap.cc:492] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: Bootstrap starting.
I20260810 14:31:02.169750 10447 tablet_bootstrap.cc:492] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: Bootstrap starting.
I20260810 14:31:02.170536 10448 tablet_bootstrap.cc:654] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:02.170567 10447 tablet_bootstrap.cc:654] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:02.171834 10448 tablet_bootstrap.cc:492] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: No bootstrap required, opened a new log
I20260810 14:31:02.171939 10448 ts_tablet_manager.cc:1397] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:02.172021 10447 tablet_bootstrap.cc:492] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: No bootstrap required, opened a new log
I20260810 14:31:02.172097 10447 ts_tablet_manager.cc:1397] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:31:02.172434 10448 raft_consensus.cc:348] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.172534 10448 raft_consensus.cc:374] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:02.172555 10448 raft_consensus.cc:729] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aaa0714476444db96d0b00543f2a323, State: Initialized, Role: FOLLOWER
I20260810 14:31:02.172570 10447 raft_consensus.cc:348] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.172676 10447 raft_consensus.cc:374] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:02.172705 10447 raft_consensus.cc:729] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Initialized, Role: FOLLOWER
I20260810 14:31:02.172690 10448 consensus_queue.cc:260] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.172850 10447 consensus_queue.cc:260] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.172972 10448 ts_tablet_manager.cc:1428] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 14:31:02.173139 10447 ts_tablet_manager.cc:1428] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:31:02.174608 10449 tablet_bootstrap.cc:492] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: Bootstrap starting.
I20260810 14:31:02.175668 10449 tablet_bootstrap.cc:654] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:02.178318 10449 tablet_bootstrap.cc:492] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: No bootstrap required, opened a new log
I20260810 14:31:02.178419 10449 ts_tablet_manager.cc:1397] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 14:31:02.178879 10449 raft_consensus.cc:348] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.179029 10449 raft_consensus.cc:374] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:02.179060 10449 raft_consensus.cc:729] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21875d1c2f0f4dea85ef522a10300a0e, State: Initialized, Role: FOLLOWER
I20260810 14:31:02.179190 10449 consensus_queue.cc:260] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.180022 10449 ts_tablet_manager.cc:1428] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:31:02.533406 10455 raft_consensus.cc:482] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:31:02.533565 10455 raft_consensus.cc:504] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.534256 10496 raft_consensus.cc:482] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:31:02.534404 10496 raft_consensus.cc:504] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.534883 10496 leader_election.cc:288] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:02.535007 10455 leader_election.cc:288] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 811c50df70be4eac91f20e299700b66a (127.1.206.67:33079)
I20260810 14:31:02.535377 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9348adc8bbda4f4988ddfbc6e5232ef9" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e" is_pre_election: true
I20260810 14:31:02.535384 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9348adc8bbda4f4988ddfbc6e5232ef9" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323" is_pre_election: true
I20260810 14:31:02.535531 10220 raft_consensus.cc:2454] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:02.535545 10072 raft_consensus.cc:2454] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:02.535907 10296 leader_election.cc:302] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21875d1c2f0f4dea85ef522a10300a0e, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:02.536128 10496 raft_consensus.cc:2781] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:31:02.536196 10496 raft_consensus.cc:482] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:31:02.536244 10496 raft_consensus.cc:3037] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.537715 10496 raft_consensus.cc:504] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.538100 10496 leader_election.cc:288] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Requested vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:02.538508 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9348adc8bbda4f4988ddfbc6e5232ef9" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e"
I20260810 14:31:02.538509 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9348adc8bbda4f4988ddfbc6e5232ef9" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323"
I20260810 14:31:02.538638 10220 raft_consensus.cc:3037] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.538638 10072 raft_consensus.cc:3037] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.539935 10220 raft_consensus.cc:2454] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:02.540345 10296 leader_election.cc:302] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21875d1c2f0f4dea85ef522a10300a0e, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:02.540539 10496 raft_consensus.cc:2781] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:02.540625 10496 raft_consensus.cc:686] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Becoming Leader. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Running, Role: LEADER
I20260810 14:31:02.540614 10072 raft_consensus.cc:2454] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:02.540771 10496 consensus_queue.cc:237] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.541357 10519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.535823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:44297 (local address 127.1.206.66:49181)
0810 14:31:02.536226 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:02.536243 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:02.536365 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:02.536848 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:02.536851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:02.536868 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:02.537002 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.537008 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.538130 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.538136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.539741 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.539754 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.540843 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.540847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.540970 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.540998 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:31:02.541066 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 14:31:02.541147 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":151,"spinlock_wait_cycles":16640,"thread_start_us":89,"threads_started":1}
I20260810 14:31:02.541489 10446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.536433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:51281 (local address 127.1.206.67:33079)
0810 14:31:02.536546 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:02.536550 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:02.536563 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:31:02.536619 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:02.536622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:02.536672 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:02.536748 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:02.537154 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.537934 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.539918 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.540601 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.540715 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.540773 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:02.541283 (+ 510us) server_negotiation.cc:299] Negotiation successful
0810 14:31:02.541374 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 14:31:02.541877 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.535380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:33079 (local address 127.1.206.66:51281)
0810 14:31:02.535837 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:02.535855 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:02.535978 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:02.536875 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:02.536878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:02.536910 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:02.537017 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.537023 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.538054 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.538060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.539757 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:02.539763 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.541008 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.541011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:02.541142 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.541162 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 14:31:02.541660 (+ 498us) client_negotiation.cc:240] Negotiation successful
0810 14:31:02.541736 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":75,"thread_start_us":91,"threads_started":1}
I20260810 14:31:02.541877 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.536190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:49181 (local address 127.1.206.65:44297)
0810 14:31:02.536505 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:02.536511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:02.536529 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:31:02.536577 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:02.536582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:02.536633 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:02.536717 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:02.537136 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.537979 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.539903 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.540628 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.540733 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.540776 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:02.541658 (+ 882us) server_negotiation.cc:299] Negotiation successful
0810 14:31:02.541737 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":111,"threads_started":1}
I20260810 14:31:02.542258 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9348adc8bbda4f4988ddfbc6e5232ef9" candidate_uuid: "21875d1c2f0f4dea85ef522a10300a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323" is_pre_election: true
I20260810 14:31:02.542491 10072 raft_consensus.cc:2379] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21875d1c2f0f4dea85ef522a10300a0e in current term 1: Already voted for candidate 811c50df70be4eac91f20e299700b66a in this term.
I20260810 14:31:02.542433 10368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9348adc8bbda4f4988ddfbc6e5232ef9" candidate_uuid: "21875d1c2f0f4dea85ef522a10300a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "811c50df70be4eac91f20e299700b66a" is_pre_election: true
I20260810 14:31:02.543292 10150 leader_election.cc:302] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21875d1c2f0f4dea85ef522a10300a0e; no voters: 0aaa0714476444db96d0b00543f2a323, 811c50df70be4eac91f20e299700b66a
I20260810 14:31:02.543566 10455 raft_consensus.cc:2726] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 14:31:02.543648 9900 catalog_manager.cc:5495] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a reported cstate change: term changed from 0 to 1, leader changed from <none> to 811c50df70be4eac91f20e299700b66a (127.1.206.67). New cstate: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } health_report { overall_health: HEALTHY } } }
I20260810 14:31:02.633445 10446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.630155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41930 (local address 127.1.206.67:33079)
0810 14:31:02.630287 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:02.630295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:02.630318 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:31:02.630433 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:02.630435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:02.630479 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:02.630544 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:31:02.630791 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.631283 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.632151 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:02.632410 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:02.632546 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:02.632868 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:31:02.632940 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:31:02.632996 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:02.633231 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 14:31:02.633301 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:31:02.635828 10220 raft_consensus.cc:1261] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.635922 10072 raft_consensus.cc:1261] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.636401 10469 consensus_queue.cc:1035] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.636632 10496 consensus_queue.cc:1035] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.645814 9900 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:02.646042 9900 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:02.648442 9900 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Sending DeleteTablet for 3 replicas of tablet 9348adc8bbda4f4988ddfbc6e5232ef9
I20260810 14:31:02.649217 10200 tablet_service.cc:1514] Processing DeleteTablet for tablet 9348adc8bbda4f4988ddfbc6e5232ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:51492
I20260810 14:31:02.649232 10051 tablet_service.cc:1514] Processing DeleteTablet for tablet 9348adc8bbda4f4988ddfbc6e5232ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:58206
I20260810 14:31:02.649905 10348 tablet_service.cc:1514] Processing DeleteTablet for tablet 9348adc8bbda4f4988ddfbc6e5232ef9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:41900
I20260810 14:31:02.650292 10533 tablet_replica.cc:330] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: stopping tablet replica
I20260810 14:31:02.650323 10535 tablet_replica.cc:330] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: stopping tablet replica
I20260810 14:31:02.650269 9900 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 14:31:02.650424 10533 raft_consensus.cc:2229] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:02.650532 10533 raft_consensus.cc:2258] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 14:31:02.650789 9900 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:31:02.650774 10535 raft_consensus.cc:2229] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:31:02.651013 10535 raft_consensus.cc:2258] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.651788 10535 ts_tablet_manager.cc:1905] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.652155 10534 tablet_replica.cc:330] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: stopping tablet replica
I20260810 14:31:02.652316 10534 raft_consensus.cc:2229] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:02.652441 10534 raft_consensus.cc:2258] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.653098 10533 ts_tablet_manager.cc:1905] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.654680 10535 ts_tablet_manager.cc:1918] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:02.654768 10535 log.cc:1196] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/9348adc8bbda4f4988ddfbc6e5232ef9
I20260810 14:31:02.655118 10535 ts_tablet_manager.cc:1939] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 811c50df70be4eac91f20e299700b66a: Deleting consensus metadata
I20260810 14:31:02.655809 10533 ts_tablet_manager.cc:1918] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:02.655889 10533 log.cc:1196] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/9348adc8bbda4f4988ddfbc6e5232ef9
I20260810 14:31:02.655977 9888 catalog_manager.cc:4841] TS 811c50df70be4eac91f20e299700b66a (127.1.206.67:33079): tablet 9348adc8bbda4f4988ddfbc6e5232ef9 (table test-table [id=cf5d88ae93bf4021bd1a8a608c8c1250]) successfully deleted
I20260810 14:31:02.656147 10533 ts_tablet_manager.cc:1939] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 0aaa0714476444db96d0b00543f2a323: Deleting consensus metadata
I20260810 14:31:02.656215 10051 tablet_service.cc:1467] Processing CreateTablet for tablet 4b24d22713b24c2eab3970c6fca06dfd (DEFAULT_TABLE table=test-table [id=8301919f82684c68864c44b995ff415d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:02.656502 10051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b24d22713b24c2eab3970c6fca06dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:02.656857 10200 tablet_service.cc:1467] Processing CreateTablet for tablet 4b24d22713b24c2eab3970c6fca06dfd (DEFAULT_TABLE table=test-table [id=8301919f82684c68864c44b995ff415d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:02.657049 10348 tablet_service.cc:1467] Processing CreateTablet for tablet 4b24d22713b24c2eab3970c6fca06dfd (DEFAULT_TABLE table=test-table [id=8301919f82684c68864c44b995ff415d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:02.657135 10200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b24d22713b24c2eab3970c6fca06dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:02.657295 10348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b24d22713b24c2eab3970c6fca06dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:02.658743 10448 tablet_bootstrap.cc:492] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323: Bootstrap starting.
I20260810 14:31:02.658771 9890 catalog_manager.cc:4841] TS 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297): tablet 9348adc8bbda4f4988ddfbc6e5232ef9 (table test-table [id=cf5d88ae93bf4021bd1a8a608c8c1250]) successfully deleted
I20260810 14:31:02.659487 10449 tablet_bootstrap.cc:492] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: Bootstrap starting.
I20260810 14:31:02.659847 10448 tablet_bootstrap.cc:654] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:02.659956 10447 tablet_bootstrap.cc:492] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: Bootstrap starting.
I20260810 14:31:02.660471 10449 tablet_bootstrap.cc:654] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:02.660910 10447 tablet_bootstrap.cc:654] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:02.661278 10448 tablet_bootstrap.cc:492] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323: No bootstrap required, opened a new log
I20260810 14:31:02.661388 10448 ts_tablet_manager.cc:1397] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:02.661783 10449 tablet_bootstrap.cc:492] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: No bootstrap required, opened a new log
I20260810 14:31:02.661876 10449 ts_tablet_manager.cc:1397] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:02.661971 10448 raft_consensus.cc:348] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.662104 10448 raft_consensus.cc:374] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:02.662160 10448 raft_consensus.cc:729] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aaa0714476444db96d0b00543f2a323, State: Initialized, Role: FOLLOWER
I20260810 14:31:02.662359 10447 tablet_bootstrap.cc:492] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: No bootstrap required, opened a new log
I20260810 14:31:02.662312 10448 consensus_queue.cc:260] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.662447 10447 ts_tablet_manager.cc:1397] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:02.662472 10449 raft_consensus.cc:348] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.662588 10449 raft_consensus.cc:374] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:02.662614 10448 ts_tablet_manager.cc:1428] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:31:02.662628 10449 raft_consensus.cc:729] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21875d1c2f0f4dea85ef522a10300a0e, State: Initialized, Role: FOLLOWER
I20260810 14:31:02.662796 10449 consensus_queue.cc:260] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.662883 10447 raft_consensus.cc:348] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.662983 10447 raft_consensus.cc:374] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:02.663017 10447 raft_consensus.cc:729] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Initialized, Role: FOLLOWER
I20260810 14:31:02.663133 10447 consensus_queue.cc:260] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.663391 10447 ts_tablet_manager.cc:1428] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 14:31:02.663857 10534 ts_tablet_manager.cc:1905] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.664201 10449 ts_tablet_manager.cc:1428] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:31:02.667270 10534 ts_tablet_manager.cc:1918] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:02.667358 10534 log.cc:1196] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/9348adc8bbda4f4988ddfbc6e5232ef9
I20260810 14:31:02.667680 10534 ts_tablet_manager.cc:1939] T 9348adc8bbda4f4988ddfbc6e5232ef9 P 21875d1c2f0f4dea85ef522a10300a0e: Deleting consensus metadata
I20260810 14:31:02.668385 9888 catalog_manager.cc:4841] TS 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435): tablet 9348adc8bbda4f4988ddfbc6e5232ef9 (table test-table [id=cf5d88ae93bf4021bd1a8a608c8c1250]) successfully deleted
I20260810 14:31:02.796453 10469 raft_consensus.cc:482] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:31:02.796607 10469 raft_consensus.cc:504] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.797138 10469 leader_election.cc:288] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:02.797696 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b24d22713b24c2eab3970c6fca06dfd" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323" is_pre_election: true
I20260810 14:31:02.797791 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b24d22713b24c2eab3970c6fca06dfd" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e" is_pre_election: true
I20260810 14:31:02.797895 10072 raft_consensus.cc:2454] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:02.798024 10220 raft_consensus.cc:2454] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 0.
I20260810 14:31:02.798333 10298 leader_election.cc:302] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aaa0714476444db96d0b00543f2a323, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:02.798583 10469 raft_consensus.cc:2781] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:31:02.798661 10469 raft_consensus.cc:482] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:31:02.798722 10469 raft_consensus.cc:3037] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.799803 10469 raft_consensus.cc:504] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.800200 10469 leader_election.cc:288] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Requested vote from peers 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297), 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435)
I20260810 14:31:02.800663 10220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b24d22713b24c2eab3970c6fca06dfd" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21875d1c2f0f4dea85ef522a10300a0e"
I20260810 14:31:02.800698 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b24d22713b24c2eab3970c6fca06dfd" candidate_uuid: "811c50df70be4eac91f20e299700b66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aaa0714476444db96d0b00543f2a323"
I20260810 14:31:02.800819 10220 raft_consensus.cc:3037] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.800840 10072 raft_consensus.cc:3037] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:02.801872 10220 raft_consensus.cc:2454] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:02.801882 10072 raft_consensus.cc:2454] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 811c50df70be4eac91f20e299700b66a in term 1.
I20260810 14:31:02.802369 10296 leader_election.cc:302] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21875d1c2f0f4dea85ef522a10300a0e, 811c50df70be4eac91f20e299700b66a; no voters:
I20260810 14:31:02.802573 10469 raft_consensus.cc:2781] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:02.802671 10469 raft_consensus.cc:686] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Becoming Leader. State: Replica: 811c50df70be4eac91f20e299700b66a, State: Running, Role: LEADER
I20260810 14:31:02.802843 10469 consensus_queue.cc:237] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } }
I20260810 14:31:02.804891 9903 catalog_manager.cc:5495] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a reported cstate change: term changed from 0 to 1, leader changed from <none> to 811c50df70be4eac91f20e299700b66a (127.1.206.67). New cstate: current_term: 1 leader_uuid: "811c50df70be4eac91f20e299700b66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "811c50df70be4eac91f20e299700b66a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 33079 } health_report { overall_health: HEALTHY } } }
I20260810 14:31:02.833441 10068 raft_consensus.cc:1261] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.833524 10219 raft_consensus.cc:1261] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Refusing update from remote peer 811c50df70be4eac91f20e299700b66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:02.833873 10541 consensus_queue.cc:1035] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aaa0714476444db96d0b00543f2a323" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.834071 10469 consensus_queue.cc:1035] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21875d1c2f0f4dea85ef522a10300a0e" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 45435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:02.872969 9903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:02.873178 9903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:02.875483 9903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 776e31622c244721bf7b82b589b16a90: Sending DeleteTablet for 3 replicas of tablet 4b24d22713b24c2eab3970c6fca06dfd
I20260810 14:31:02.876243 10347 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b24d22713b24c2eab3970c6fca06dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:41900
I20260810 14:31:02.876200 10051 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b24d22713b24c2eab3970c6fca06dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:58206
I20260810 14:31:02.876365 10200 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b24d22713b24c2eab3970c6fca06dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:02 UTC) from {username='oryx', principal='oryx/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:51492
I20260810 14:31:02.876479 10535 tablet_replica.cc:330] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: stopping tablet replica
I20260810 14:31:02.876519 10533 tablet_replica.cc:330] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323: stopping tablet replica
I20260810 14:31:02.876551 10534 tablet_replica.cc:330] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: stopping tablet replica
I20260810 14:31:02.876614 10535 raft_consensus.cc:2229] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:31:02.876636 10533 raft_consensus.cc:2229] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:02.876638 10534 raft_consensus.cc:2229] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:02.876765 10533 raft_consensus.cc:2258] T 4b24d22713b24c2eab3970c6fca06dfd P 0aaa0714476444db96d0b00543f2a323 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.876765 10534 raft_consensus.cc:2258] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.876843 10535 raft_consensus.cc:2258] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:02.877250 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 9983
I20260810 14:31:02.877712 10535 ts_tablet_manager.cc:1905] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.877864 10534 ts_tablet_manager.cc:1905] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:02.881770 10535 ts_tablet_manager.cc:1918] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:31:02.881886 10535 log.cc:1196] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/4b24d22713b24c2eab3970c6fca06dfd
I20260810 14:31:02.881943 10534 ts_tablet_manager.cc:1918] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:31:02.882052 10534 log.cc:1196] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/4b24d22713b24c2eab3970c6fca06dfd
I20260810 14:31:02.882211 10535 ts_tablet_manager.cc:1939] T 4b24d22713b24c2eab3970c6fca06dfd P 811c50df70be4eac91f20e299700b66a: Deleting consensus metadata
I20260810 14:31:02.882342 10534 ts_tablet_manager.cc:1939] T 4b24d22713b24c2eab3970c6fca06dfd P 21875d1c2f0f4dea85ef522a10300a0e: Deleting consensus metadata
I20260810 14:31:02.883037 9888 catalog_manager.cc:4841] TS 811c50df70be4eac91f20e299700b66a (127.1.206.67:33079): tablet 4b24d22713b24c2eab3970c6fca06dfd (table test-table [id=8301919f82684c68864c44b995ff415d]) successfully deleted
I20260810 14:31:02.883265 9888 catalog_manager.cc:4841] TS 21875d1c2f0f4dea85ef522a10300a0e (127.1.206.66:45435): tablet 4b24d22713b24c2eab3970c6fca06dfd (table test-table [id=8301919f82684c68864c44b995ff415d]) successfully deleted
I20260810 14:31:02.888731 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 10133
W20260810 14:31:02.888700 9890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:44297 (error 108)
I20260810 14:31:02.892225 10548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:02.891797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:44297 (local address 127.0.0.1:58214)
0810 14:31:02.892040 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:02.892129 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:44297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":86,"threads_started":1}
W20260810 14:31:02.892438 9890 catalog_manager.cc:4584] TS 0aaa0714476444db96d0b00543f2a323 (127.1.206.65:44297): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4b24d22713b24c2eab3970c6fca06dfd: Network error: Client connection negotiation failed: client connection to 127.1.206.65:44297: connect: Connection refused (error 111)
I20260810 14:31:02.897437 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 10278
I20260810 14:31:02.907506 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 9871
2026-08-10T14:31:02Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3702 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:31:02 dist-test-slave-0b58 krb5kdc[10551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:31:02 dist-test-slave-0b58 krb5kdc[10551](info): set up 2 sockets
Aug 10 14:31:02 dist-test-slave-0b58 krb5kdc[10551](info): commencing operation
krb5kdc: starting...
W20260810 14:31:04.008559 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:31:04 dist-test-slave-0b58 krb5kdc[10551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:31:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:31:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:31:04.147262 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:38961
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:45627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:38961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:04.267907 10564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:04.268226 10564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:04.268353 10564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:04.272563 10564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:31:04.272631 10564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:04.272651 10564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:04.272668 10564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:31:04.272683 10564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:31:04.278391 10564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:38961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:38961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:04.279513 10564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:04.280565 10564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:04.290037 10570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:04.290038 10572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:04.290073 10569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:04.290134 10564 server_base.cc:1034] running on GCE node
I20260810 14:31:04.291174 10564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:04.292505 10564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:04.293735 10564 hybrid_clock.cc:648] HybridClock initialized: now 1786372264293702 us; error 53 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T14:31:04Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1394 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:31:04 dist-test-slave-0b58 krb5kdc[10578](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:31:04 dist-test-slave-0b58 krb5kdc[10578](info): set up 2 sockets
Aug 10 14:31:04 dist-test-slave-0b58 krb5kdc[10578](info): commencing operation
krb5kdc: starting...
W20260810 14:31:05.404381 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:31:05 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:31:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:31:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:31:05.541738 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34409
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:34409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:05.659754 10591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:05.660125 10591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:05.660211 10591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:05.664534 10591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:31:05.664664 10591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:05.664701 10591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:05.664742 10591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:31:05.664801 10591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:31:05.670681 10591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:34409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:05.671921 10591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:05.673027 10591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:05.682288 10596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:05.682284 10597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:05.682440 10591 server_base.cc:1034] running on GCE node
W20260810 14:31:05.682384 10599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:05.683286 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:05.684590 10591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:05.685792 10591 hybrid_clock.cc:648] HybridClock initialized: now 1786372265685775 us; error 34 us; skew 500 ppm
Aug 10 14:31:05 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372265, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:05.693199 10591 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:31:05.694201 10591 webserver.cc:460] Webserver started at http://127.1.206.126:37447/ using document root <none> and password file <none>
I20260810 14:31:05.694789 10591 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:05.694856 10591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:05.695037 10591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:05.697297 10591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "a05abe828dd546faac0f6225a7630a76"
format_stamp: "Formatted at 2026-08-10 14:31:05 on dist-test-slave-0b58"
server_key: "9d1a614249a7ef9299188894f117f07c"
server_key_iv: "93dc5ce741bcb62f093d0d6aac202216"
server_key_version: "encryptionkey@0"
I20260810 14:31:05.697860 10591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "a05abe828dd546faac0f6225a7630a76"
format_stamp: "Formatted at 2026-08-10 14:31:05 on dist-test-slave-0b58"
server_key: "9d1a614249a7ef9299188894f117f07c"
server_key_iv: "93dc5ce741bcb62f093d0d6aac202216"
server_key_version: "encryptionkey@0"
I20260810 14:31:05.701897 10591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:31:05.704500 10606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:05.705819 10591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:31:05.705983 10591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "a05abe828dd546faac0f6225a7630a76"
format_stamp: "Formatted at 2026-08-10 14:31:05 on dist-test-slave-0b58"
server_key: "9d1a614249a7ef9299188894f117f07c"
server_key_iv: "93dc5ce741bcb62f093d0d6aac202216"
server_key_version: "encryptionkey@0"
I20260810 14:31:05.706122 10591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:05.738242 10591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:05.742138 10591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:05.742384 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:05.750644 10591 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:34409
I20260810 14:31:05.750777 10665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:34409 every 8 connection(s)
I20260810 14:31:05.751781 10591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:31:05.755082 10666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:05.760636 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 10591
I20260810 14:31:05.760797 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:31:05.761108 1849 external_mini_cluster.cc:1428] Setting key b7304b68638dc5b8b332a2bedb3dda56
I20260810 14:31:05.762257 10666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Bootstrap starting.
I20260810 14:31:05.765220 10666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:05.766134 10666 log.cc:824] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:05.768507 10666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: No bootstrap required, opened a new log
Aug 10 14:31:05 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:31:05.773981 10666 raft_consensus.cc:348] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:05.774322 10666 raft_consensus.cc:374] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:05.774434 10666 raft_consensus.cc:729] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a05abe828dd546faac0f6225a7630a76, State: Initialized, Role: FOLLOWER
I20260810 14:31:05.775075 10666 consensus_queue.cc:260] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:05.775290 10666 raft_consensus.cc:388] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:31:05.775389 10666 raft_consensus.cc:482] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:31:05.775514 10666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:05.776965 10666 raft_consensus.cc:504] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:05.777395 10666 leader_election.cc:302] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a05abe828dd546faac0f6225a7630a76; no voters:
I20260810 14:31:05.777782 10666 leader_election.cc:288] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:31:05.777909 10671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:05.778190 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:05.762702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39072 (local address 127.1.206.126:34409)
0810 14:31:05.763296 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:05.763314 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:05.763358 (+ 44us) server_negotiation.cc:407] Connection header received
0810 14:31:05.764132 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:05.764157 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:05.764631 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:05.765030 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:05.765940 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:05.767097 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:05.768017 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:05.768599 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:05.768810 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:05.772089 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:05.772095 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:05.772112 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:05.772187 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:05.774303 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:05.775023 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:05.775028 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:05.775034 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:05.775167 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:05.775607 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:05.775610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:05.775611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:05.776134 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:05.776363 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:05.776706 (+ 343us) server_negotiation.cc:299] Negotiation successful
0810 14:31:05.777048 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":189,"threads_started":1}
I20260810 14:31:05.778155 10671 raft_consensus.cc:686] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 LEADER]: Becoming Leader. State: Replica: a05abe828dd546faac0f6225a7630a76, State: Running, Role: LEADER
I20260810 14:31:05.778558 10671 consensus_queue.cc:237] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:05.779404 10666 sys_catalog.cc:564] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:31:05.779999 10671 sys_catalog.cc:455] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a05abe828dd546faac0f6225a7630a76. Latest consensus state: current_term: 1 leader_uuid: "a05abe828dd546faac0f6225a7630a76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } } }
I20260810 14:31:05.780139 10671 sys_catalog.cc:458] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:05.780787 10676 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:31:05.780718 10672 sys_catalog.cc:455] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a05abe828dd546faac0f6225a7630a76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } } }
I20260810 14:31:05.781001 10672 sys_catalog.cc:458] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:05.784305 10676 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:31:05.791541 10676 catalog_manager.cc:1347] Generated new cluster ID: 315bda80b28c468ca1d6f85b6a2f125a
I20260810 14:31:05.791644 10676 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:31:05.802611 10676 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:31:05.804013 10676 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:31:05.812139 10676 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Generated new TSK 0
I20260810 14:31:05.813154 10676 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:31:05.852947 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34409
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:05.974301 10694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:05.974611 10694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:05.974658 10694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:05.978929 10694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:05.979079 10694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:05.979197 10694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:31:05.985186 10694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:05.986403 10694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:05.987494 10694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:05.997668 10702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:05.997673 10699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:05.997673 10700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:05.998023 10694 server_base.cc:1034] running on GCE node
I20260810 14:31:05.998554 10694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:05.999284 10694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:06.000483 10694 hybrid_clock.cc:648] HybridClock initialized: now 1786372266000466 us; error 31 us; skew 500 ppm
Aug 10 14:31:05 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372265, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:06.003468 10694 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:31:06.004494 10694 webserver.cc:460] Webserver started at http://127.1.206.65:39821/ using document root <none> and password file <none>
I20260810 14:31:06.005043 10694 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:06.005105 10694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:06.005275 10694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:06.007411 10694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "50a5a32be71d4a5cba9796a3c74b2dad"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "dd184a7c7c96a9a8708a89ea07d8c56d"
server_key_iv: "74b29668b8e4ad57241aa5758fb5ef52"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.007984 10694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "50a5a32be71d4a5cba9796a3c74b2dad"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "dd184a7c7c96a9a8708a89ea07d8c56d"
server_key_iv: "74b29668b8e4ad57241aa5758fb5ef52"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.012228 10694 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 14:31:06.014767 10709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.016010 10694 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:06.016111 10694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "50a5a32be71d4a5cba9796a3c74b2dad"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "dd184a7c7c96a9a8708a89ea07d8c56d"
server_key_iv: "74b29668b8e4ad57241aa5758fb5ef52"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.016206 10694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:06.038460 10694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:06.041692 10694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:06.041873 10694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:06.042443 10694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:06.043265 10694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:06.043315 10694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.043357 10694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:06.043372 10694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.054032 10694 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:41827
I20260810 14:31:06.054057 10834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:41827 every 8 connection(s)
I20260810 14:31:06.055027 10694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:31:06.061364 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 10694
I20260810 14:31:06.061527 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:31:06.061846 1849 external_mini_cluster.cc:1428] Setting key f732605656bc83825aa0a3c02df2ef47
Aug 10 14:31:06 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372265, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:31:06.070778 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:06.057056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:34169 (local address 127.1.206.126:34409)
0810 14:31:06.057235 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:06.057239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:06.058230 (+ 991us) server_negotiation.cc:407] Connection header received
0810 14:31:06.059628 (+ 1398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:06.059631 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:06.059694 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:06.059774 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:06.061094 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.061769 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.063044 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.063297 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.063414 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:06.066215 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:06.066218 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:06.066220 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:06.066246 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:06.068021 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:06.068792 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:06.068803 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:06.068804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:06.068902 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:06.069378 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:06.069384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:06.069392 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:06.069632 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:06.069766 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:06.070384 (+ 618us) server_negotiation.cc:299] Negotiation successful
0810 14:31:06.070560 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 14:31:06.071699 10837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:06.057449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:34169)
0810 14:31:06.057926 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:06.057972 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:06.059387 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:06.059955 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:06.059962 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:06.060381 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:06.060900 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:06.060927 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.061908 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.061916 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:06.062903 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:06.062914 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.063462 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.063467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:06.063658 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:06.064425 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:06.064443 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:06.065989 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:06.068212 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:06.068221 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:06.068248 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:06.068646 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:06.069016 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:06.069021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:06.069023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:06.069245 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:06.069765 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:06.069775 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:06.070082 (+ 307us) client_negotiation.cc:769] Sending connection context
0810 14:31:06.070312 (+ 230us) client_negotiation.cc:240] Negotiation successful
0810 14:31:06.070724 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":129,"threads_started":1}
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:31:06.073266 10835 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34409
I20260810 14:31:06.073549 10835 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:06.074043 10835 heartbeater.cc:511] Master 127.1.206.126:34409 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:31:06.075790 10628 ts_manager.cc:194] Registered new tserver with Master: 50a5a32be71d4a5cba9796a3c74b2dad (127.1.206.65:41827)
I20260810 14:31:06.077478 10628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:34169
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:31:06.094997 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34409
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:06.214716 10840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:06.215073 10840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:06.215168 10840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:06.219740 10840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:06.219854 10840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:06.219954 10840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:31:06.227843 10840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:06.229249 10840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:06.230660 10840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:06.241628 10846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:06.241724 10845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:06.241761 10848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:06.241935 10840 server_base.cc:1034] running on GCE node
I20260810 14:31:06.242435 10840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:06.243088 10840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:06.244321 10840 hybrid_clock.cc:648] HybridClock initialized: now 1786372266244297 us; error 30 us; skew 500 ppm
Aug 10 14:31:06 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372266, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:06.247408 10840 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:31:06.248505 10840 webserver.cc:460] Webserver started at http://127.1.206.66:39255/ using document root <none> and password file <none>
I20260810 14:31:06.249107 10840 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:06.249202 10840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:06.249444 10840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:06.251603 10840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "1fd08d579d374a73855fcecf1039cbf1"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "7152c60e77001f4590884598c33a5118"
server_key_iv: "0324733b698fbc418fa8568706d92a57"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.252204 10840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "1fd08d579d374a73855fcecf1039cbf1"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "7152c60e77001f4590884598c33a5118"
server_key_iv: "0324733b698fbc418fa8568706d92a57"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.256104 10840 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260810 14:31:06.258639 10856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.259866 10840 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:06.260004 10840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "1fd08d579d374a73855fcecf1039cbf1"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "7152c60e77001f4590884598c33a5118"
server_key_iv: "0324733b698fbc418fa8568706d92a57"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.260123 10840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:06.280558 10840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:06.284123 10840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:06.284387 10840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:06.285018 10840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:06.285894 10840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:06.285965 10840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.286038 10840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:06.286099 10840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.295451 10840 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:34933
I20260810 14:31:06.295478 10978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:34933 every 8 connection(s)
I20260810 14:31:06.296468 10840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:31:06.303471 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 10840
I20260810 14:31:06.303589 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:31:06.303872 1849 external_mini_cluster.cc:1428] Setting key 5b78ec245d2a356fbaa26fb2e9107b32
Aug 10 14:31:06 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372266, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:31:06.312105 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:06.298415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:54685 (local address 127.1.206.126:34409)
0810 14:31:06.298598 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:06.298603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:06.299459 (+ 856us) server_negotiation.cc:407] Connection header received
0810 14:31:06.300908 (+ 1449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:06.300911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:06.300958 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:06.301031 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:06.302307 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.302846 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.304308 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.304575 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.304714 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:06.307702 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:06.307706 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:06.307708 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:06.307737 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:06.309353 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:06.310072 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:06.310075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:06.310076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:06.310208 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:06.310686 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:06.310689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:06.310691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:06.310925 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:06.311006 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:06.311824 (+ 818us) server_negotiation.cc:299] Negotiation successful
0810 14:31:06.311979 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 14:31:06.313799 10981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:06.298808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:54685)
0810 14:31:06.299292 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:06.299340 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:06.300704 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:06.301211 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:06.301217 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:06.301626 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:06.302146 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:06.302160 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.302966 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.302968 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:06.304128 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:06.304139 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.304774 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.304777 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:06.304936 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:06.305667 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:06.305689 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:06.307497 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:06.309493 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:06.309503 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:06.309525 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:06.309963 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:06.310317 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:06.310324 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:06.310329 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:06.310550 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:06.311054 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:06.311065 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:06.311473 (+ 408us) client_negotiation.cc:769] Sending connection context
0810 14:31:06.311750 (+ 277us) client_negotiation.cc:240] Negotiation successful
0810 14:31:06.312199 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":127,"threads_started":1}
I20260810 14:31:06.315204 10979 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34409
I20260810 14:31:06.315488 10979 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:06.316028 10979 heartbeater.cc:511] Master 127.1.206.126:34409 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:31:06.317293 10628 ts_manager.cc:194] Registered new tserver with Master: 1fd08d579d374a73855fcecf1039cbf1 (127.1.206.66:34933)
I20260810 14:31:06.317988 10628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:54685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:31:06.337327 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34409
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:06.455801 10984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:06.456112 10984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:06.456158 10984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:06.460438 10984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:06.460532 10984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:06.460597 10984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:31:06.466846 10984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:06.468063 10984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:06.469120 10984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:06.479357 10989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:06.479429 10990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:06.479447 10992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:06.479863 10984 server_base.cc:1034] running on GCE node
I20260810 14:31:06.480495 10984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:06.481261 10984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:06.482481 10984 hybrid_clock.cc:648] HybridClock initialized: now 1786372266482463 us; error 33 us; skew 500 ppm
Aug 10 14:31:06 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372266, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:06.485775 10984 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:31:06.486871 10984 webserver.cc:460] Webserver started at http://127.1.206.67:35645/ using document root <none> and password file <none>
I20260810 14:31:06.487495 10984 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:06.487594 10984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:06.487844 10984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:06.490168 10984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "051518d369a44f37b3d737499e038da5"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "8f9a3a8874564b968516ee2ba6398792"
server_key_iv: "227fc51ab90a4ba072d9611500fa6800"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.490803 10984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "051518d369a44f37b3d737499e038da5"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "8f9a3a8874564b968516ee2ba6398792"
server_key_iv: "227fc51ab90a4ba072d9611500fa6800"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.495036 10984 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260810 14:31:06.498073 10999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.499630 10984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:06.499751 10984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "051518d369a44f37b3d737499e038da5"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "8f9a3a8874564b968516ee2ba6398792"
server_key_iv: "227fc51ab90a4ba072d9611500fa6800"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.499861 10984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:06.516103 10984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:06.520769 10984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:06.521476 10984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:06.522338 10984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:06.523617 10984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:06.523682 10984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.523772 10984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:06.523810 10984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.533831 10984 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:42103
I20260810 14:31:06.533934 11123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:42103 every 8 connection(s)
I20260810 14:31:06.534916 10984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:31:06.535884 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 10984
I20260810 14:31:06.536058 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:31:06.536439 1849 external_mini_cluster.cc:1428] Setting key a5b010a25e7c61bcaf3cc4018c13adb8
Aug 10 14:31:06 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372266, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:31:06.551623 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:06.537418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:38391 (local address 127.1.206.126:34409)
0810 14:31:06.537566 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:06.537571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:06.538828 (+ 1257us) server_negotiation.cc:407] Connection header received
0810 14:31:06.540411 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:06.540414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:06.540482 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:06.540561 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:06.541979 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.542652 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.543886 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.544121 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.544220 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:06.547239 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:06.547243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:06.547245 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:06.547317 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:06.548998 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:06.549645 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:06.549651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:06.549653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:06.549779 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:06.550259 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:06.550262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:06.550272 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:06.550493 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:06.550576 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:06.551365 (+ 789us) server_negotiation.cc:299] Negotiation successful
0810 14:31:06.551495 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 14:31:06.552587 11126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:06.537951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:38391)
0810 14:31:06.538635 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:06.538701 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:06.540087 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:06.540796 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:06.540804 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:06.541225 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:06.541778 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:06.541793 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.542788 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.542790 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:06.543742 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:06.543753 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:06.544438 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:06.544442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:06.544611 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:06.545266 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:06.545284 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:06.546949 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:06.549138 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:06.549144 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:06.549160 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:06.549506 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:06.549889 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:06.549892 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:06.549893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:06.550149 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:06.550594 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:06.550605 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:06.551024 (+ 419us) client_negotiation.cc:769] Sending connection context
0810 14:31:06.551266 (+ 242us) client_negotiation.cc:240] Negotiation successful
0810 14:31:06.551601 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":185,"threads_started":1}
I20260810 14:31:06.553731 11124 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34409
I20260810 14:31:06.554004 11124 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:06.554543 11124 heartbeater.cc:511] Master 127.1.206.126:34409 requested a full tablet report, sending...
I20260810 14:31:06.555639 10628 ts_manager.cc:194] Registered new tserver with Master: 051518d369a44f37b3d737499e038da5 (127.1.206.67:42103)
I20260810 14:31:06.556236 10628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:38391
I20260810 14:31:06.563231 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab.
Entry for principal oryx/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab.
WARNING: no policy specified for oryx/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab.
Entry for principal oryx/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab.
WARNING: no policy specified for oryx/127.1.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab.
Entry for principal oryx/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab.
I20260810 14:31:06.652154 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 10694
I20260810 14:31:06.661458 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 10840
I20260810 14:31:06.670147 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 10984
I20260810 14:31:06.679128 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 10591
I20260810 14:31:06.688622 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34409
--webserver_interface=127.1.206.126
--webserver_port=37447
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:34409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:06.805073 11133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:06.805392 11133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:06.805436 11133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:06.809669 11133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:31:06.809755 11133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:06.809775 11133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:06.809793 11133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:31:06.809811 11133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:31:06.815486 11133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:34409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=37447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:06.816656 11133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:06.817641 11133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:31:06.826514 11133 server_base.cc:1034] running on GCE node
W20260810 14:31:06.826476 11139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:06.826476 11142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:06.826479 11140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:06.827298 11133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:06.828586 11133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:06.829811 11133 hybrid_clock.cc:648] HybridClock initialized: now 1786372266829776 us; error 51 us; skew 500 ppm
Aug 10 14:31:06 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372266, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:06.833001 11133 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:31:06.834165 11133 webserver.cc:460] Webserver started at http://127.1.206.126:37447/ using document root <none> and password file <none>
I20260810 14:31:06.834811 11133 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:06.834942 11133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:06.839314 11133 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:06.841743 11149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:06.843040 11133 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:31:06.843248 11133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "a05abe828dd546faac0f6225a7630a76"
format_stamp: "Formatted at 2026-08-10 14:31:05 on dist-test-slave-0b58"
server_key: "9d1a614249a7ef9299188894f117f07c"
server_key_iv: "93dc5ce741bcb62f093d0d6aac202216"
server_key_version: "encryptionkey@0"
I20260810 14:31:06.843891 11133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:06.856005 11133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:06.859450 11133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:06.859689 11133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:06.867873 11133 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:34409
I20260810 14:31:06.867882 11204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:34409 every 8 connection(s)
I20260810 14:31:06.869205 11133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:31:06.873811 11205 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:31:06.875452 11205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Bootstrap starting.
I20260810 14:31:06.876339 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 11133
I20260810 14:31:06.876902 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:41827
--local_ip_for_outbound_sockets=127.1.206.65
--tserver_master_addrs=127.1.206.126:34409
--webserver_port=39821
--webserver_interface=127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:31:06.893793 11205 log.cc:824] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:06.900738 11205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:31:06.901150 11205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Bootstrap complete.
I20260810 14:31:06.905653 11205 raft_consensus.cc:348] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:06.906097 11205 raft_consensus.cc:729] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a05abe828dd546faac0f6225a7630a76, State: Initialized, Role: FOLLOWER
I20260810 14:31:06.906616 11205 consensus_queue.cc:260] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:06.906769 11205 raft_consensus.cc:388] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:31:06.906839 11205 raft_consensus.cc:482] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:31:06.906953 11205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:31:06.909088 11205 raft_consensus.cc:504] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:06.909447 11205 leader_election.cc:302] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a05abe828dd546faac0f6225a7630a76; no voters:
I20260810 14:31:06.909798 11205 leader_election.cc:288] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:31:06.909895 11209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:31:06.910127 11209 raft_consensus.cc:686] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [term 2 LEADER]: Becoming Leader. State: Replica: a05abe828dd546faac0f6225a7630a76, State: Running, Role: LEADER
I20260810 14:31:06.910430 11209 consensus_queue.cc:237] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } }
I20260810 14:31:06.911134 11205 sys_catalog.cc:564] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:31:06.911406 11209 sys_catalog.cc:455] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a05abe828dd546faac0f6225a7630a76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } } }
I20260810 14:31:06.911516 11209 sys_catalog.cc:458] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:06.911795 11210 sys_catalog.cc:455] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a05abe828dd546faac0f6225a7630a76. Latest consensus state: current_term: 2 leader_uuid: "a05abe828dd546faac0f6225a7630a76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a05abe828dd546faac0f6225a7630a76" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34409 } } }
I20260810 14:31:06.911916 11210 sys_catalog.cc:458] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:06.912101 11213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:31:06.915529 11213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:31:06.916206 11213 catalog_manager.cc:1259] Loaded cluster ID: 315bda80b28c468ca1d6f85b6a2f125a
I20260810 14:31:06.916288 11213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:31:06.918690 11213 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:31:06.919374 11213 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a05abe828dd546faac0f6225a7630a76: Loaded TSK: 0
I20260810 14:31:06.920648 11213 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:31:06.996307 11207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:06.996639 11207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:06.996726 11207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:07.000962 11207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:07.001071 11207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:07.001164 11207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:31:07.006698 11207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.65.keytab
--principal=oryx/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:41827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=39821
--tserver_master_addrs=127.1.206.126:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:07.007845 11207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:07.008968 11207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:07.019325 11235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:07.019405 11233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:07.019364 11232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:07.019847 11207 server_base.cc:1034] running on GCE node
I20260810 14:31:07.020357 11207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:07.021226 11207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:07.022421 11207 hybrid_clock.cc:648] HybridClock initialized: now 1786372267022397 us; error 35 us; skew 500 ppm
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372267, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:07.025640 11207 init.cc:377] Logged in from keytab as oryx/127.1.206.65@KRBTEST.COM (short username oryx)
I20260810 14:31:07.026772 11207 webserver.cc:460] Webserver started at http://127.1.206.65:39821/ using document root <none> and password file <none>
I20260810 14:31:07.027349 11207 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:07.027460 11207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:07.031780 11207 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:07.034396 11242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.035873 11207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 14:31:07.036046 11207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "50a5a32be71d4a5cba9796a3c74b2dad"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "dd184a7c7c96a9a8708a89ea07d8c56d"
server_key_iv: "74b29668b8e4ad57241aa5758fb5ef52"
server_key_version: "encryptionkey@0"
I20260810 14:31:07.036718 11207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:07.056865 11207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:07.060313 11207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:07.060547 11207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:07.061218 11207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:07.062148 11207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:07.062222 11207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.062292 11207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:07.062335 11207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.072151 11207 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:41827
I20260810 14:31:07.072176 11365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:41827 every 8 connection(s)
I20260810 14:31:07.073304 11207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:31:07.074816 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 11207
I20260810 14:31:07.075400 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:34933
--local_ip_for_outbound_sockets=127.1.206.66
--tserver_master_addrs=127.1.206.126:34409
--webserver_port=39255
--webserver_interface=127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:07.089794 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.075865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:43285)
0810 14:31:07.076536 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.076581 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.077833 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.079024 (+ 1191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.079031 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.079589 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.080341 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.080367 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.081774 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.081781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.083469 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.083487 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.084377 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.084383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.084643 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.085515 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.085542 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.088704 (+ 3162us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":143,"threads_started":1}
W20260810 14:31:07.089787 11368 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.075700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:43285 (local address 127.1.206.126:34409)
0810 14:31:07.076220 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.076240 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.076720 (+ 480us) server_negotiation.cc:407] Connection header received
0810 14:31:07.078276 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.078288 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.078592 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.078936 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.080585 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.081605 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.083638 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.084139 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.084464 (+ 325us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.088960 (+ 4496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:43285: BlockingRecv error: recv got EOF from 127.1.206.65:43285 (error 108)
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":160,"threads_started":1}
W20260810 14:31:07.090389 11366 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:34409 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.206.126:34409: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:07.096740 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.090947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:54293)
0810 14:31:07.091144 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.091160 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.091264 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.091527 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.091530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.091701 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.091803 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.091808 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.092635 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.092640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.093195 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.093204 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.093675 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.093678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.093775 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.094397 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.094409 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.096582 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119}
W20260810 14:31:07.096850 11368 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.091033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:54293 (local address 127.1.206.126:34409)
0810 14:31:07.091150 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.091153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.091224 (+ 71us) server_negotiation.cc:407] Connection header received
0810 14:31:07.091357 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.091359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.091404 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.091507 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.091925 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.092527 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.093322 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.093560 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.093671 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.096722 (+ 3051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:54293: BlockingRecv error: recv got EOF from 127.1.206.65:54293 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:07.102631 11369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.097473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:58007)
0810 14:31:07.097571 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.097587 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.097690 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.097938 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.097941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.098097 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.098168 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.098173 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.098893 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.098898 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.099419 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.099427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.099889 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.099893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.099975 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.100520 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.100533 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.102473 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 14:31:07.102885 11368 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.097578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:58007 (local address 127.1.206.126:34409)
0810 14:31:07.097722 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.097729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.097745 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:31:07.097782 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.097784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.097839 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.097919 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.098281 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.098776 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.099545 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.099772 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.099887 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.102612 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:58007: BlockingRecv error: recv got EOF from 127.1.206.65:58007 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 14:31:07.102885 11366 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:31:07.205034 11370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:07.205371 11370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:07.205449 11370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:07.210275 11370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:07.210361 11370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:07.210425 11370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:31:07.216506 11370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.66.keytab
--principal=oryx/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:34933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=39255
--tserver_master_addrs=127.1.206.126:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:07.217612 11370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:07.218649 11370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:07.229334 11379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:07.229439 11377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:07.229334 11375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:07.229678 11370 server_base.cc:1034] running on GCE node
I20260810 14:31:07.230142 11370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:07.230916 11370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:07.232105 11370 hybrid_clock.cc:648] HybridClock initialized: now 1786372267232073 us; error 43 us; skew 500 ppm
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372267, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:07.236061 11370 init.cc:377] Logged in from keytab as oryx/127.1.206.66@KRBTEST.COM (short username oryx)
I20260810 14:31:07.237226 11370 webserver.cc:460] Webserver started at http://127.1.206.66:39255/ using document root <none> and password file <none>
I20260810 14:31:07.238147 11370 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:07.238260 11370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:07.243057 11370 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260810 14:31:07.245731 11386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.247242 11370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:31:07.247400 11370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "1fd08d579d374a73855fcecf1039cbf1"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "7152c60e77001f4590884598c33a5118"
server_key_iv: "0324733b698fbc418fa8568706d92a57"
server_key_version: "encryptionkey@0"
I20260810 14:31:07.248063 11370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:07.266825 11370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:07.270573 11370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:07.270810 11370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:07.271546 11370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:07.272455 11370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:07.272503 11370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.272572 11370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:07.272604 11370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.282197 11370 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:34933
I20260810 14:31:07.282346 11504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:34933 every 8 connection(s)
I20260810 14:31:07.283313 11370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:31:07.285449 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 11370
I20260810 14:31:07.285941 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:42103
--local_ip_for_outbound_sockets=127.1.206.67
--tserver_master_addrs=127.1.206.126:34409
--webserver_port=35645
--webserver_interface=127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:31:07.296829 11368 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.285488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:46145 (local address 127.1.206.126:34409)
0810 14:31:07.285651 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.285656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.286704 (+ 1048us) server_negotiation.cc:407] Connection header received
0810 14:31:07.288555 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.288559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.288630 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.288748 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.290040 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.290898 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.292133 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.292600 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.292753 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.296630 (+ 3877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:46145: BlockingRecv error: recv got EOF from 127.1.206.66:46145 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 14:31:07.297322 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.285861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:46145)
0810 14:31:07.286490 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.286558 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.288319 (+ 1761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.288949 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.288957 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.289368 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.289871 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.289885 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.291058 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.291062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.291997 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.292007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.292781 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.292785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.292942 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.293639 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.293656 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.296410 (+ 2754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":181,"threads_started":1}
W20260810 14:31:07.297978 11505 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:34409 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.206.126:34409: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:07.304137 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.298463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:45641)
0810 14:31:07.298681 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.298709 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.298779 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.299037 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.299039 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.299176 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.299281 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.299286 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.300411 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.300413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.300965 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.300973 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.301523 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.301525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.301594 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.302129 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.302141 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.304031 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139}
W20260810 14:31:07.304356 11368 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.298590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:45641 (local address 127.1.206.126:34409)
0810 14:31:07.298759 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.298766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.298787 (+ 21us) server_negotiation.cc:407] Connection header received
0810 14:31:07.298852 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.298856 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.298917 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.299019 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.299404 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.300308 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.301071 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.301414 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.301518 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.304206 (+ 2688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:45641: BlockingRecv error: recv got EOF from 127.1.206.66:45641 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:07.309979 11507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.304830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:51357)
0810 14:31:07.304945 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.304962 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.305046 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.305307 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.305310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.305469 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.305536 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.305541 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.306285 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.306290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.306805 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.306812 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.307246 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.307250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.307329 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.307834 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.307846 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.309819 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 14:31:07.310214 11505 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:31:07.310081 11368 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.304915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:51357 (local address 127.1.206.126:34409)
0810 14:31:07.305027 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.305031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.305043 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:31:07.305147 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.305150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.305199 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.305292 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.305660 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.306173 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.306919 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.307134 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.307244 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.309958 (+ 2714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:51357: BlockingRecv error: recv got EOF from 127.1.206.66:51357 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 14:31:07.408757 11508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:07.409090 11508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:07.409175 11508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:07.413652 11508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:07.413749 11508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:07.413851 11508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:31:07.422955 11508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/krb5kdc/oryx_127.1.206.67.keytab
--principal=oryx/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:42103
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=35645
--tserver_master_addrs=127.1.206.126:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:07.424520 11508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:07.425933 11508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:07.439049 11515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:07.439049 11516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:07.439081 11518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:07.439568 11508 server_base.cc:1034] running on GCE node
I20260810 14:31:07.440093 11508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:07.441097 11508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:07.442296 11508 hybrid_clock.cc:648] HybridClock initialized: now 1786372267442255 us; error 58 us; skew 500 ppm
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372267, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:07.446077 11508 init.cc:377] Logged in from keytab as oryx/127.1.206.67@KRBTEST.COM (short username oryx)
I20260810 14:31:07.447391 11508 webserver.cc:460] Webserver started at http://127.1.206.67:35645/ using document root <none> and password file <none>
I20260810 14:31:07.448060 11508 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:07.448181 11508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:07.454054 11508 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:31:07.456524 11525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.458194 11508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:07.458316 11508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "051518d369a44f37b3d737499e038da5"
format_stamp: "Formatted at 2026-08-10 14:31:06 on dist-test-slave-0b58"
server_key: "8f9a3a8874564b968516ee2ba6398792"
server_key_iv: "227fc51ab90a4ba072d9611500fa6800"
server_key_version: "encryptionkey@0"
I20260810 14:31:07.458926 11508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:07.476830 11508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:07.480453 11508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:07.480679 11508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:07.481319 11508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:07.482187 11508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:07.482256 11508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.482372 11508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:07.482420 11508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:07.492004 11508 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:42103
I20260810 14:31:07.492022 11656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:42103 every 8 connection(s)
I20260810 14:31:07.493134 11508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:31:07.495545 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 11508
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:31:07.506749 11368 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.495021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:34951 (local address 127.1.206.126:34409)
0810 14:31:07.495192 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.495197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.496212 (+ 1015us) server_negotiation.cc:407] Connection header received
0810 14:31:07.498150 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.498152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.498196 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.498284 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.499635 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.500391 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.502354 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.502702 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.502818 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.506587 (+ 3769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:34951: BlockingRecv error: recv got EOF from 127.1.206.67:34951 (error 108)
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":67}
I20260810 14:31:07.507279 11661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.496701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39088 (local address 127.1.206.126:34409)
0810 14:31:07.496940 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.496943 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.496957 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:31:07.496997 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.497000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.497040 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.497124 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.498130 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.498760 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.499906 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.500310 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.500416 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.502296 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:07.502329 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:07.502350 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:07.502388 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:07.504692 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:07.505241 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:07.505248 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:07.505255 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:07.505451 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:07.505766 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:07.505769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:07.505770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:07.506177 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:07.506346 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:07.506745 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 14:31:07.507160 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":167,"thread_start_us":103,"threads_started":1}
I20260810 14:31:07.507637 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.495493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:34951)
0810 14:31:07.496050 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.496111 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.497937 (+ 1826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.498420 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.498426 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.498776 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.499477 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.499498 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.500518 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.500522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.502231 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.502244 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.502889 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.502893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.503067 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.503607 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.503623 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.506424 (+ 2801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":165,"threads_started":1}
W20260810 14:31:07.508292 11657 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:34409 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.206.126:34409: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:07.514722 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.508825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:59137)
0810 14:31:07.508980 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.508996 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.509087 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.509372 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.509375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.509786 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.509891 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.509897 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.510735 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.510740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.511308 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.511316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.511872 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.511876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.512000 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.512588 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.512599 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.514607 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":63}
W20260810 14:31:07.514863 11661 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.508920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:59137 (local address 127.1.206.126:34409)
0810 14:31:07.509034 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.509039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.509054 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:31:07.509173 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.509176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.509223 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.509356 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.510015 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.510597 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.511437 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.511725 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.511868 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.514748 (+ 2880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:59137: BlockingRecv error: recv got EOF from 127.1.206.67:59137 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:07 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:07.520117 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:07.515407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:54503)
0810 14:31:07.515522 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:07.515539 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:07.515613 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:07.515826 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:07.515829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:07.515955 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:07.516026 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.516030 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.516781 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.516784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.517313 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:07.517322 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.517722 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.517725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:07.517783 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.518186 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:07.518196 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:07.519966 (+ 1770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 14:31:07.520184 11661 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:07.515501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:54503 (local address 127.1.206.126:34409)
0810 14:31:07.515642 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:07.515645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:07.515657 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:31:07.515690 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:07.515692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:07.515725 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:07.515798 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:07.516121 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.516686 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.517426 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:07.517629 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:07.517706 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:07.520077 (+ 2371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:54503: BlockingRecv error: recv got EOF from 127.1.206.67:54503 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260810 14:31:07.520428 11657 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 14:31:08 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:08 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:08.110307 11662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:08.103710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:41401)
0810 14:31:08.104013 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:08.104028 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:08.104197 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:08.104558 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:08.104561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:08.104755 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:08.104894 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:08.104903 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.105984 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.105990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:08.106651 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:08.106663 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.107169 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.107172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:08.107245 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:08.107839 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:08.107853 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:08.110166 (+ 2313us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":107,"threads_started":1}
W20260810 14:31:08.110569 11663 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:08.103901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:41401 (local address 127.1.206.126:34409)
0810 14:31:08.104183 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:08.104187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:08.104202 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:31:08.104339 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:08.104342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:08.104392 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:08.104502 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:08.105200 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.105855 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.106794 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.107027 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.107117 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:08.110421 (+ 3304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:41401: BlockingRecv error: recv got EOF from 127.1.206.65:41401 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":124,"threads_started":1}
Aug 10 14:31:08 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:08 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:08.317442 11664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:08.311135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:43487)
0810 14:31:08.311436 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:08.311451 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:08.311563 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:08.312021 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:08.312026 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:08.312226 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:08.312400 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:08.312407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.313312 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.313315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:08.313904 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:08.313915 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.314450 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.314453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:08.314542 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:08.315174 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:08.315190 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:08.317302 (+ 2112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":109,"threads_started":1}
W20260810 14:31:08.317791 11663 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:08.311295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:43487 (local address 127.1.206.126:34409)
0810 14:31:08.311465 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:08.311469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:08.311529 (+ 60us) server_negotiation.cc:407] Connection header received
0810 14:31:08.311729 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:08.311732 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:08.311786 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:08.311874 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:08.312554 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.313178 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.314065 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.314322 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.314441 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:08.317497 (+ 3056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:43487: BlockingRecv error: recv got EOF from 127.1.206.66:43487 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 10 14:31:08 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:08 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:08.527007 11665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:08.521200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:44939)
0810 14:31:08.521584 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:08.521598 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:08.521705 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:08.521949 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:08.521952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:08.522140 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:08.522273 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:08.522279 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.523045 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.523048 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:08.523648 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:08.523658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.524176 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.524179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:08.524250 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:08.524913 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:08.524925 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:08.526876 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":147,"threads_started":1}
W20260810 14:31:08.527298 11663 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:08.521257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44939 (local address 127.1.206.126:34409)
0810 14:31:08.521417 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:08.521422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:08.521674 (+ 252us) server_negotiation.cc:407] Connection header received
0810 14:31:08.521797 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:08.521799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:08.521848 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:08.521908 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:08.522379 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.522920 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.523783 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:08.524012 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:08.524095 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:08.527090 (+ 2995us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:44939: BlockingRecv error: recv got EOF from 127.1.206.67:44939 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 10 14:31:09 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:09 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:09.118628 11666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:09.111378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:42965)
0810 14:31:09.111735 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:09.111751 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:09.111872 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:09.112215 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:09.112220 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:09.112604 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:09.112729 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:09.112735 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.113581 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.113584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:09.114170 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:09.114179 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.114807 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.114811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:09.114913 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:09.115490 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:09.115504 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:09.118422 (+ 2918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":95,"threads_started":1}
W20260810 14:31:09.118839 11667 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:09.111433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:42965 (local address 127.1.206.126:34409)
0810 14:31:09.111736 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:09.111740 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:09.111832 (+ 92us) server_negotiation.cc:407] Connection header received
0810 14:31:09.111972 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:09.111975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:09.112020 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:09.112102 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:09.112849 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.113457 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.114320 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.114548 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.114778 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:09.118659 (+ 3881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:42965: BlockingRecv error: recv got EOF from 127.1.206.65:42965 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":112,"threads_started":1}
Aug 10 14:31:09 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:09 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:09.324218 11668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:09.318391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:38007)
0810 14:31:09.318684 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:09.318707 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:09.318808 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:09.319052 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:09.319054 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:09.319277 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:09.319388 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:09.319394 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.320228 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.320231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:09.320916 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:09.320928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.321416 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.321419 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:09.321492 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:09.322042 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:09.322054 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:09.324024 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":115,"threads_started":1}
W20260810 14:31:09.324378 11667 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:09.318452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:38007 (local address 127.1.206.126:34409)
0810 14:31:09.318619 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:09.318645 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:09.318783 (+ 138us) server_negotiation.cc:407] Connection header received
0810 14:31:09.318891 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:09.318894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:09.318939 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:09.319013 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:09.319514 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.320090 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.321051 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.321282 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.321365 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:09.324193 (+ 2828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:38007: BlockingRecv error: recv got EOF from 127.1.206.66:38007 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 10 14:31:09 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:09 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:09.534566 11670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:09.527891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:50701)
0810 14:31:09.528283 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:09.528301 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:09.528467 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:09.528833 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:09.528836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:09.529046 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:09.529177 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:09.529183 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.529974 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.529978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:09.530545 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:09.530553 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.531043 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.531047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:09.531153 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:09.531752 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:09.531765 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:09.534355 (+ 2590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":110,"threads_started":1}
W20260810 14:31:09.534742 11667 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:09.528078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:50701 (local address 127.1.206.126:34409)
0810 14:31:09.528296 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:09.528303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:09.528395 (+ 92us) server_negotiation.cc:407] Connection header received
0810 14:31:09.528612 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:09.528616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:09.528706 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:09.528800 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:09.529310 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.529857 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.530676 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:09.530910 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:09.531023 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:09.534612 (+ 3589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:50701: BlockingRecv error: recv got EOF from 127.1.206.67:50701 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 10 14:31:10 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:10 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:10.126165 11672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:10.119702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:44933)
0810 14:31:10.120008 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:10.120023 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:10.120121 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:10.120526 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:10.120529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:10.120731 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:10.120837 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:10.120842 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.121697 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.121700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:10.122307 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:10.122317 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.122822 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.122825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:10.122903 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:10.123470 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:10.123482 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:10.125971 (+ 2489us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":104,"threads_started":1}
W20260810 14:31:10.126475 11673 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:10.119793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:44933 (local address 127.1.206.126:34409)
0810 14:31:10.120077 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:10.120081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:10.120099 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:31:10.120299 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:10.120302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:10.120354 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:10.120448 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:10.120989 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.121559 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.122447 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.122682 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.122769 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:10.126176 (+ 3407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:44933: BlockingRecv error: recv got EOF from 127.1.206.65:44933 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":120,"threads_started":1}
Aug 10 14:31:10 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:10 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:10.330837 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:10.325131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:52919)
0810 14:31:10.325494 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:10.325509 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:10.325617 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:10.325858 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:10.325861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:10.326048 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:10.326164 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:10.326170 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.326999 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.327002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:10.327586 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:10.327594 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.328082 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.328085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:10.328155 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:10.328834 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:10.328846 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:10.330707 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":153,"threads_started":1}
W20260810 14:31:10.331043 11673 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:10.325196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:52919 (local address 127.1.206.126:34409)
0810 14:31:10.325362 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:10.325368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:10.325604 (+ 236us) server_negotiation.cc:407] Connection header received
0810 14:31:10.325702 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:10.325704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:10.325751 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:10.325816 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:10.326349 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.326888 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.327721 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.327962 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.328048 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:10.330897 (+ 2849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:52919: BlockingRecv error: recv got EOF from 127.1.206.66:52919 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 14:31:10 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:10 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:10.543344 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:10.535613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:49155)
0810 14:31:10.535915 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:10.535930 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:10.536035 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:10.536643 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:10.536650 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:10.536920 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:10.537085 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:10.537094 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.538373 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.538380 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:10.539309 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:10.539327 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.539964 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.539969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:10.540052 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:10.540700 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:10.540714 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:10.543186 (+ 2472us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":109,"threads_started":1}
W20260810 14:31:10.543581 11673 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:10.535771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:49155 (local address 127.1.206.126:34409)
0810 14:31:10.535952 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:10.535956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:10.535981 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:31:10.536250 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:10.536281 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:10.536443 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:10.536552 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:10.537236 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.538223 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.539448 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:10.539815 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:10.539952 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:10.543457 (+ 3505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:49155: BlockingRecv error: recv got EOF from 127.1.206.67:49155 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 10 14:31:11 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:11 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:11.137943 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:11.127178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:49745)
0810 14:31:11.127527 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:11.127552 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:11.127669 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:11.128011 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:11.128013 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:11.128225 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:11.128428 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:11.128436 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.129239 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.129244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:11.129907 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:11.129917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.130412 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.130415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:11.130505 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:11.135390 (+ 4885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:11.135407 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:11.137805 (+ 2398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":95,"threads_started":1}
W20260810 14:31:11.138235 11677 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:11.127350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:49745 (local address 127.1.206.126:34409)
0810 14:31:11.127633 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:11.127637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:11.127653 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:31:11.127817 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:11.127821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:11.127872 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:11.127960 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:11.128557 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.129106 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.130043 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.130278 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.130406 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:11.138088 (+ 7682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:49745: BlockingRecv error: recv got EOF from 127.1.206.65:49745 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":87,"threads_started":1}
Aug 10 14:31:11 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:11 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:11.337504 11678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:11.331737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:53613)
0810 14:31:11.332022 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:11.332045 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:11.332146 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:11.332405 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:11.332407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:11.332589 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:11.332688 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:11.332693 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.333448 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.333451 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:11.334023 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:11.334031 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.334504 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.334507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:11.334579 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:11.335199 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:11.335215 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:11.337382 (+ 2167us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":110,"threads_started":1}
W20260810 14:31:11.337643 11677 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:11.331881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:53613 (local address 127.1.206.126:34409)
0810 14:31:11.332035 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:11.332039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:11.332102 (+ 63us) server_negotiation.cc:407] Connection header received
0810 14:31:11.332219 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:11.332221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:11.332286 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:11.332367 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:11.332810 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.333336 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.334142 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.334366 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.334451 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:11.337520 (+ 3069us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:53613: BlockingRecv error: recv got EOF from 127.1.206.66:53613 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 14:31:11 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:11 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:11.550462 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:11.544513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:41889)
0810 14:31:11.544798 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:11.544814 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:11.544926 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:11.545180 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:11.545183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:11.545402 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:11.545506 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:11.545512 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.546397 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.546400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:11.546965 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:11.546974 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.547556 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.547560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:11.547644 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:11.548306 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:11.548320 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:11.550337 (+ 2017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":80,"threads_started":1}
W20260810 14:31:11.550690 11677 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:11.544619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:41889 (local address 127.1.206.126:34409)
0810 14:31:11.544803 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:11.544809 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:11.544870 (+ 61us) server_negotiation.cc:407] Connection header received
0810 14:31:11.545016 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:11.545019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:11.545068 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:11.545141 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:11.545657 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.546262 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.547104 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:11.547345 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:11.547441 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:11.550542 (+ 3101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:41889: BlockingRecv error: recv got EOF from 127.1.206.67:41889 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 10 14:31:12 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:12 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:12.145434 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:12.138927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:54899)
0810 14:31:12.139235 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:12.139250 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:12.139341 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:12.139702 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:12.139704 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:12.139937 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:12.140036 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:12.140042 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.141087 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.141090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:12.141710 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:12.141721 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.142275 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.142278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:12.142352 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:12.142947 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:12.142960 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:12.145307 (+ 2347us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":114,"threads_started":1}
W20260810 14:31:12.145762 11681 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:12.139029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:54899 (local address 127.1.206.126:34409)
0810 14:31:12.139301 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:12.139308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:12.139330 (+ 22us) server_negotiation.cc:407] Connection header received
0810 14:31:12.139509 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:12.139512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:12.139564 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:12.139652 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:12.140156 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.140961 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.141864 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.142109 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.142212 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:12.145617 (+ 3405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:54899: BlockingRecv error: recv got EOF from 127.1.206.65:54899 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":87,"threads_started":1}
Aug 10 14:31:12 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:12 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:12.344597 11682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:12.338521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:35977)
0810 14:31:12.338869 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:12.338884 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:12.338983 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:12.339239 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:12.339241 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:12.339433 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:12.339529 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:12.339534 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.340421 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.340424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:12.340989 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:12.340997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.341535 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.341538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:12.341616 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:12.342177 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:12.342189 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:12.344468 (+ 2279us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":91,"threads_started":1}
W20260810 14:31:12.345026 11681 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:12.338748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:35977 (local address 127.1.206.126:34409)
0810 14:31:12.338894 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:12.338898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:12.338937 (+ 39us) server_negotiation.cc:407] Connection header received
0810 14:31:12.339069 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:12.339071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:12.339114 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:12.339190 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:12.339627 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.340322 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.341105 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.341433 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.341518 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:12.344692 (+ 3174us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:35977: BlockingRecv error: recv got EOF from 127.1.206.66:35977 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 14:31:12 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:12 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:12.557571 11684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:12.551396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:44109)
0810 14:31:12.551720 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:12.551739 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:12.551902 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:12.552227 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:12.552230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:12.552483 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:12.552631 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:12.552641 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.553492 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.553498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:12.554082 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:12.554090 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.554576 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.554580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:12.554669 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:12.555200 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:12.555212 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:12.557394 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":96,"threads_started":1}
W20260810 14:31:12.557678 11681 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:12.551537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44109 (local address 127.1.206.126:34409)
0810 14:31:12.551697 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:12.551702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:12.551839 (+ 137us) server_negotiation.cc:407] Connection header received
0810 14:31:12.552048 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:12.552056 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:12.552109 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:12.552199 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:12.552755 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.553371 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.554212 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:12.554451 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:12.554560 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:12.557550 (+ 2990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:44109: BlockingRecv error: recv got EOF from 127.1.206.67:44109 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 14:31:13 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:13 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:13.152628 11686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:13.146511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:51249)
0810 14:31:13.146985 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:13.147005 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:13.147144 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:13.147482 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:13.147487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:13.147780 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:13.147947 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:13.147958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.148788 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.148794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:13.149409 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:13.149418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.149862 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.149864 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:13.149924 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:13.150429 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:13.150442 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:13.152466 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":92,"threads_started":1}
W20260810 14:31:13.152907 11687 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:13.146715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:51249 (local address 127.1.206.126:34409)
0810 14:31:13.147000 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:13.147005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:13.147105 (+ 100us) server_negotiation.cc:407] Connection header received
0810 14:31:13.147268 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:13.147272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:13.147335 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:13.147423 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:13.148086 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.148647 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.149518 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.149752 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.149839 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:13.152773 (+ 2934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:51249: BlockingRecv error: recv got EOF from 127.1.206.65:51249 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":86,"threads_started":1}
Aug 10 14:31:13 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:13 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:13.352236 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:13.345652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:54635)
0810 14:31:13.345989 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:13.346005 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:13.346130 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:13.346424 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:13.346427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:13.346646 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:13.346748 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:13.346753 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.347649 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.347652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:13.348387 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:13.348400 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.349185 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.349188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:13.349300 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:13.349901 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:13.349913 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:13.352047 (+ 2134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":117,"threads_started":1}
W20260810 14:31:13.352624 11687 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:13.345738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:54635 (local address 127.1.206.126:34409)
0810 14:31:13.345910 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:13.345916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:13.346099 (+ 183us) server_negotiation.cc:407] Connection header received
0810 14:31:13.346219 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:13.346222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:13.346271 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:13.346366 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:13.346881 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.347507 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.348719 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.349035 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.349145 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:13.352497 (+ 3352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:54635: BlockingRecv error: recv got EOF from 127.1.206.66:54635 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 10 14:31:13 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:13 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:13.565024 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:13.558556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:51297)
0810 14:31:13.558839 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:13.558855 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:13.558969 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:13.559308 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:13.559310 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:13.559513 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:13.559612 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:13.559617 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.560553 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.560556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:13.561148 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:13.561158 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.561687 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.561691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:13.561813 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:13.562495 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:13.562510 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:13.564894 (+ 2384us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":106,"threads_started":1}
W20260810 14:31:13.565176 11687 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:13.558751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:51297 (local address 127.1.206.126:34409)
0810 14:31:13.558902 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:13.558906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:13.558922 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:31:13.559064 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:13.559066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:13.559124 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:13.559216 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:13.559809 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.560408 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.561285 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:13.561538 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:13.561633 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:13.565049 (+ 3416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:51297: BlockingRecv error: recv got EOF from 127.1.206.67:51297 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 14:31:14 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:14 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:14.159245 11691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:14.153495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:34653)
0810 14:31:14.153970 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:14.153984 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:14.154081 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:14.154294 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:14.154296 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:14.154480 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:14.154575 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:14.154580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.155328 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.155331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:14.155921 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:14.155930 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.156352 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.156355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:14.156419 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:14.156940 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:14.156953 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:14.159101 (+ 2148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":88,"threads_started":1}
W20260810 14:31:14.159440 11692 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:14.153557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:34653 (local address 127.1.206.126:34409)
0810 14:31:14.153924 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:14.153928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:14.154036 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:31:14.154147 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:14.154149 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:14.154192 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:14.154268 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:14.154692 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.155220 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.156029 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.156248 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.156343 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:14.159285 (+ 2942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:34653: BlockingRecv error: recv got EOF from 127.1.206.65:34653 (error 108)
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":152,"threads_started":1}
Aug 10 14:31:14 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:14 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:14.359138 11693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:14.353339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:41125)
0810 14:31:14.353707 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:14.353721 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:14.353826 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:14.354124 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:14.354127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:14.354350 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:14.354450 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:14.354456 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.355257 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.355259 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:14.355829 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:14.355837 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.356352 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.356354 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:14.356418 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:14.356987 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:14.356998 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:14.359005 (+ 2007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":114,"threads_started":1}
W20260810 14:31:14.359303 11692 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:14.353499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:41125 (local address 127.1.206.126:34409)
0810 14:31:14.353682 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:14.353686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:14.353798 (+ 112us) server_negotiation.cc:407] Connection header received
0810 14:31:14.353920 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:14.353923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:14.353970 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:14.354034 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:14.354582 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.355152 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.355947 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.356198 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.356353 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:14.359160 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:41125: BlockingRecv error: recv got EOF from 127.1.206.66:41125 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 10 14:31:14 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:14 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:14.572440 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:14.566012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:51513)
0810 14:31:14.566672 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:14.566691 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:14.566832 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:14.567160 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:14.567164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:14.567390 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:14.567494 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:14.567500 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.568328 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.568339 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:14.568970 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:14.568980 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.569413 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.569416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:14.569481 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:14.570051 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:14.570066 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:14.572238 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":159,"threads_started":1}
W20260810 14:31:14.572583 11692 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:14.566300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:51513 (local address 127.1.206.126:34409)
0810 14:31:14.566446 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:14.566450 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:14.566796 (+ 346us) server_negotiation.cc:407] Connection header received
0810 14:31:14.566922 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:14.566925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:14.566984 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:14.567094 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:14.567610 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.568147 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.569082 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:14.569307 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:14.569388 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:14.572446 (+ 3058us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:51513: BlockingRecv error: recv got EOF from 127.1.206.67:51513 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 14:31:15 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:15 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:15.166728 11695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:15.160351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:56757)
0810 14:31:15.160649 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:15.160663 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:15.160760 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:15.161042 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:15.161044 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:15.161228 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:15.161332 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:15.161338 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.162101 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.162104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:15.162698 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:15.162708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.163263 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.163267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:15.163351 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:15.163996 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:15.164019 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:15.166549 (+ 2530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":110,"threads_started":1}
W20260810 14:31:15.166887 11696 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:15.160567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:56757 (local address 127.1.206.126:34409)
0810 14:31:15.160819 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:15.160823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:15.160837 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:31:15.160881 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:15.160883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:15.160926 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:15.161006 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:15.161449 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.162001 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.162849 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.163128 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.163288 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:15.166713 (+ 3425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:56757: BlockingRecv error: recv got EOF from 127.1.206.65:56757 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":99,"threads_started":1}
Aug 10 14:31:15 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:15 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:15.366367 11697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:15.360139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:34561)
0810 14:31:15.360491 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:15.360505 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:15.360610 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:15.360888 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:15.360890 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:15.361082 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:15.361189 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:15.361202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.362307 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.362310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:15.362935 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:15.362945 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.363487 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.363490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:15.363558 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:15.364171 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:15.364183 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:15.366237 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":163,"threads_started":1}
W20260810 14:31:15.366554 11696 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:15.360201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:34561 (local address 127.1.206.126:34409)
0810 14:31:15.360420 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:15.360427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:15.360582 (+ 155us) server_negotiation.cc:407] Connection header received
0810 14:31:15.360709 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:15.360711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:15.360780 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:15.360855 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:15.361320 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.362167 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.363054 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.363372 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.363463 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:15.366418 (+ 2955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:34561: BlockingRecv error: recv got EOF from 127.1.206.66:34561 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 10 14:31:15 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:15 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:15.579233 11698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:15.573454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:33889)
0810 14:31:15.573875 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:15.573892 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:15.574023 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:15.574359 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:15.574363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:15.574615 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:15.574737 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:15.574744 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.575502 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.575504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:15.576080 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:15.576088 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.576584 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.576587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:15.576666 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:15.577291 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:15.577304 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:15.579114 (+ 1810us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":92,"threads_started":1}
W20260810 14:31:15.579526 11696 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:15.573591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:33889 (local address 127.1.206.126:34409)
0810 14:31:15.573736 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:15.573741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:15.573981 (+ 240us) server_negotiation.cc:407] Connection header received
0810 14:31:15.574133 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:15.574139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:15.574213 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:15.574281 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:15.574863 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.575400 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.576185 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:15.576477 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:15.576560 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:15.579266 (+ 2706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:33889: BlockingRecv error: recv got EOF from 127.1.206.67:33889 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 14:31:16 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:16 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:16.177652 11700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:16.167716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:52441)
0810 14:31:16.168028 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:16.168043 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:16.168177 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:16.168507 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:16.168510 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:16.168690 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:16.168792 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:16.168797 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.169569 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.169571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:16.170116 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:16.170123 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.170568 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.170571 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:16.170634 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:16.175106 (+ 4472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:16.175130 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:16.177502 (+ 2372us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":120,"threads_started":1}
W20260810 14:31:16.177886 11701 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:16.167784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:52441 (local address 127.1.206.126:34409)
0810 14:31:16.168036 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:16.168040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:16.168115 (+ 75us) server_negotiation.cc:407] Connection header received
0810 14:31:16.168289 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:16.168291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:16.168336 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:16.168423 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:16.168906 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.169466 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.170214 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.170461 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.170540 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:16.177684 (+ 7144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:52441: BlockingRecv error: recv got EOF from 127.1.206.65:52441 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":95,"threads_started":1}
Aug 10 14:31:16 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:16 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:16.373359 11702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:16.367384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:58629)
0810 14:31:16.367728 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:16.367746 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:16.367873 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:16.368178 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:16.368181 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:16.368457 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:16.368591 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:16.368601 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.369382 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.369384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:16.369941 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:16.369949 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.370398 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.370401 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:16.370468 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:16.371034 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:16.371045 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:16.373157 (+ 2112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":113,"threads_started":1}
W20260810 14:31:16.373402 11701 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:16.367524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:58629 (local address 127.1.206.126:34409)
0810 14:31:16.367679 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:16.367686 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:16.367832 (+ 146us) server_negotiation.cc:407] Connection header received
0810 14:31:16.367973 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:16.367976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:16.368035 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:16.368133 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:16.368731 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.369282 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.370056 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.370292 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.370376 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:16.373296 (+ 2920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:58629: BlockingRecv error: recv got EOF from 127.1.206.66:58629 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 14:31:16 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:16 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:16.586138 11703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:16.580158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:45401)
0810 14:31:16.580492 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:16.580506 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:16.580613 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:16.580872 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:16.580874 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:16.581067 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:16.581164 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:16.581169 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.582119 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.582123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:16.582898 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:16.582909 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.583391 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.583394 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:16.583481 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:16.584006 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:16.584018 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:16.585988 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":135,"threads_started":1}
W20260810 14:31:16.586383 11701 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:16.580365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:45401 (local address 127.1.206.126:34409)
0810 14:31:16.580507 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:16.580511 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:16.580560 (+ 49us) server_negotiation.cc:407] Connection header received
0810 14:31:16.580703 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:16.580705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:16.580751 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:16.580844 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:16.581270 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.581998 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.583030 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:16.583261 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:16.583375 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:16.586139 (+ 2764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:45401: BlockingRecv error: recv got EOF from 127.1.206.67:45401 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 14:31:17 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:17 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:17.184900 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:17.178667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:58265)
0810 14:31:17.179025 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:17.179040 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:17.179172 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:17.179504 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:17.179506 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:17.179700 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:17.179800 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:17.179806 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.180637 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.180640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:17.181294 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:17.181304 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.181811 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.181813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:17.181888 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:17.182519 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:17.182531 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:17.184731 (+ 2200us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":126,"threads_started":1}
W20260810 14:31:17.185124 11705 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:17.178844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:58265 (local address 127.1.206.126:34409)
0810 14:31:17.179075 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:17.179078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:17.179096 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:31:17.179312 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:17.179316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:17.179364 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:17.179451 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:17.179924 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.180503 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.181439 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.181675 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.181767 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:17.184978 (+ 3211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:58265: BlockingRecv error: recv got EOF from 127.1.206.65:58265 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":65,"threads_started":1}
Aug 10 14:31:17 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:17 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:17.386178 11706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:17.374310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:60165)
0810 14:31:17.374760 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:17.374778 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:17.374953 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:17.375230 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:17.375233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:17.375463 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:17.375558 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:17.375564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.376493 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.376498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:17.377068 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:17.377076 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.377551 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.377554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:17.377645 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:17.383938 (+ 6293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:17.383954 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:17.386030 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":107,"threads_started":1}
W20260810 14:31:17.386394 11705 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:17.374480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:60165 (local address 127.1.206.126:34409)
0810 14:31:17.374757 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:17.374761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:17.374893 (+ 132us) server_negotiation.cc:407] Connection header received
0810 14:31:17.375063 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:17.375072 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:17.375120 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:17.375214 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:17.375700 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.376378 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.377196 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.377431 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.377545 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:17.386243 (+ 8698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:60165: BlockingRecv error: recv got EOF from 127.1.206.66:60165 (error 108)
Metrics: {"server-negotiator.queue_time_us":165}
Aug 10 14:31:17 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:17 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:17.593478 11707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:17.587031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:43045)
0810 14:31:17.587343 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:17.587360 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:17.587522 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:17.587899 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:17.587903 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:17.588162 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:17.588387 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:17.588399 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.589375 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.589378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:17.589961 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:17.589970 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.590487 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.590490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:17.590563 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:17.591175 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:17.591188 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:17.593348 (+ 2160us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":100,"threads_started":1}
W20260810 14:31:17.593732 11705 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:17.587227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:43045 (local address 127.1.206.126:34409)
0810 14:31:17.587345 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:17.587359 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:17.587455 (+ 96us) server_negotiation.cc:407] Connection header received
0810 14:31:17.587644 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:17.587649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:17.587739 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:17.587826 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:17.588635 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.589230 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.590111 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:17.590369 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:17.590464 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:17.593543 (+ 3079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:43045: BlockingRecv error: recv got EOF from 127.1.206.67:43045 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 14:31:18 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:18 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:18.191594 11708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:18.185883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:46617)
0810 14:31:18.186176 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:18.186194 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:18.186302 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:18.186627 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:18.186629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:18.186826 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:18.186922 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:18.186928 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.187722 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.187725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:18.188358 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:18.188368 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.188852 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.188854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:18.188919 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:18.189474 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:18.189486 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:18.191472 (+ 1986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":106,"threads_started":1}
W20260810 14:31:18.191795 11709 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:18.185971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:46617 (local address 127.1.206.126:34409)
0810 14:31:18.186263 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:18.186267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:18.186282 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:31:18.186438 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:18.186441 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:18.186492 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:18.186584 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:18.187032 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.187579 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.188509 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.188744 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.188840 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:18.191643 (+ 2803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:46617: BlockingRecv error: recv got EOF from 127.1.206.65:46617 (error 108)
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":130,"threads_started":1}
Aug 10 14:31:18 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:18 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:18.393623 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:18.387317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:33413)
0810 14:31:18.387725 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:18.387741 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:18.387882 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:18.388201 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:18.388205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:18.388453 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:18.388555 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:18.388561 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.389415 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.389417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:18.389983 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:18.390000 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.390532 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.390534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:18.390603 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:18.391185 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:18.391197 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:18.393424 (+ 2227us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":110,"threads_started":1}
W20260810 14:31:18.393735 11709 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:18.387386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:33413 (local address 127.1.206.126:34409)
0810 14:31:18.387563 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:18.387569 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:18.387837 (+ 268us) server_negotiation.cc:407] Connection header received
0810 14:31:18.387981 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:18.387983 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:18.388061 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:18.388151 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:18.388718 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.389287 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.390162 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.390410 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.390511 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:18.393589 (+ 3078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:33413: BlockingRecv error: recv got EOF from 127.1.206.66:33413 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 10 14:31:18 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:18 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:18.599660 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:18.594269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:53157)
0810 14:31:18.594534 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:18.594548 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:18.594647 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:18.594921 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:18.594923 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:18.595110 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:18.595208 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:18.595213 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.595950 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.595952 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:18.596556 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:18.596564 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.596994 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.596997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:18.597059 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:18.597579 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:18.597594 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:18.599504 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":72,"threads_started":1}
W20260810 14:31:18.599823 11709 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:18.594400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:53157 (local address 127.1.206.126:34409)
0810 14:31:18.594566 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:18.594570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:18.594603 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:31:18.594734 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:18.594736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:18.594782 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:18.594850 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:18.595323 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.595847 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.596666 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:18.596895 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:18.596976 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:18.599669 (+ 2693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:53157: BlockingRecv error: recv got EOF from 127.1.206.67:53157 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 10 14:31:19 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:19 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:19.197860 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:19.192517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:57199)
0810 14:31:19.192825 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:19.192840 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:19.192933 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:19.193179 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:19.193181 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:19.193369 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:19.193469 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:19.193475 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.194199 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.194201 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:19.194745 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:19.194761 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.195181 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.195183 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:19.195245 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:19.195762 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:19.195774 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:19.197718 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":109,"threads_started":1}
W20260810 14:31:19.198046 11713 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:19.192646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:57199 (local address 127.1.206.126:34409)
0810 14:31:19.192911 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:19.192915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:19.192929 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:31:19.193019 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:19.193021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:19.193064 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:19.193137 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:19.193578 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.194102 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.194858 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.195082 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.195161 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:19.197903 (+ 2742us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:57199: BlockingRecv error: recv got EOF from 127.1.206.65:57199 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":93,"threads_started":1}
Aug 10 14:31:19 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:19 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:19.399917 11715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:19.394645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:54735)
0810 14:31:19.394933 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:19.394947 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:19.395048 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:19.395304 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:19.395306 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:19.395487 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:19.395581 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:19.395586 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.396386 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.396388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:19.396939 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:19.396946 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.397378 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.397381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:19.397449 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:19.397945 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:19.397956 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:19.399789 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":104,"threads_started":1}
W20260810 14:31:19.400110 11713 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:19.394799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:54735 (local address 127.1.206.126:34409)
0810 14:31:19.394950 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:19.394954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:19.395016 (+ 62us) server_negotiation.cc:407] Connection header received
0810 14:31:19.395133 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:19.395135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:19.395187 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:19.395265 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:19.395715 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.396291 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.397052 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.397271 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.397350 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:19.399964 (+ 2614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:54735: BlockingRecv error: recv got EOF from 127.1.206.66:54735 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 14:31:19 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:19 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:19.606439 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:19.600603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:60395)
0810 14:31:19.600896 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:19.600911 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:19.601052 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:19.601360 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:19.601363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:19.601586 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:19.601679 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:19.601685 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.602476 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.602482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:19.603052 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:19.603059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.603568 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.603572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:19.603661 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:19.604284 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:19.604300 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:19.606323 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":88,"threads_started":1}
W20260810 14:31:19.606617 11713 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:19.600680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:60395 (local address 127.1.206.126:34409)
0810 14:31:19.600851 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:19.600856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:19.600996 (+ 140us) server_negotiation.cc:407] Connection header received
0810 14:31:19.601178 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:19.601181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:19.601229 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:19.601336 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:19.601818 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.602363 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.603183 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:19.603443 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:19.603551 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:19.606462 (+ 2911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:60395: BlockingRecv error: recv got EOF from 127.1.206.67:60395 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 10 14:31:20 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:20 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:20.204351 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:20.198724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:57265)
0810 14:31:20.199033 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:20.199047 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:20.199140 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:20.199405 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:20.199407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:20.199591 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:20.199704 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:20.199710 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.200528 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.200531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:20.201113 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:20.201122 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.201570 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.201573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:20.201640 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:20.202247 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:20.202260 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:20.204168 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":122,"threads_started":1}
W20260810 14:31:20.204560 11718 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:20.198838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:57265 (local address 127.1.206.126:34409)
0810 14:31:20.199089 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:20.199092 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:20.199107 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:31:20.199231 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:20.199234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:20.199278 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:20.199360 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:20.199808 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.200424 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.201231 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.201458 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.201540 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:20.204376 (+ 2836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:57265: BlockingRecv error: recv got EOF from 127.1.206.65:57265 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":98,"threads_started":1}
Aug 10 14:31:20 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:20 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:20.406350 11719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:20.400738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:45815)
0810 14:31:20.401062 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:20.401084 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:20.401199 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:20.401473 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:20.401475 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:20.401677 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:20.401778 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:20.401783 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.402545 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.402547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:20.403141 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:20.403151 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.403618 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.403622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:20.403717 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:20.404317 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:20.404330 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:20.406215 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":101,"threads_started":1}
W20260810 14:31:20.406497 11718 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:20.400952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:45815 (local address 127.1.206.126:34409)
0810 14:31:20.401077 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:20.401081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:20.401164 (+ 83us) server_negotiation.cc:407] Connection header received
0810 14:31:20.401298 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:20.401300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:20.401346 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:20.401424 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:20.401893 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.402439 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.403273 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.403487 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.403567 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:20.406377 (+ 2810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:45815: BlockingRecv error: recv got EOF from 127.1.206.66:45815 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 14:31:20 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:20 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:20.613834 11720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:20.607407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:41961)
0810 14:31:20.607732 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:20.607746 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:20.607857 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:20.608171 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:20.608174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:20.608388 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:20.608482 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:20.608487 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.609363 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.609366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:20.609959 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:20.609967 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.610553 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.610557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:20.610642 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:20.611436 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:20.611449 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:20.613701 (+ 2252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":89,"threads_started":1}
W20260810 14:31:20.614051 11718 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:20.607505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:41961 (local address 127.1.206.126:34409)
0810 14:31:20.607750 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:20.607754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:20.607806 (+ 52us) server_negotiation.cc:407] Connection header received
0810 14:31:20.607985 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:20.607988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:20.608049 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:20.608128 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:20.608633 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.609242 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.610098 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:20.610411 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:20.610548 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:20.613903 (+ 3355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:41961: BlockingRecv error: recv got EOF from 127.1.206.67:41961 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
Aug 10 14:31:21 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:21 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:21.216750 11721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:21.205213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:56861)
0810 14:31:21.205541 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:21.205556 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:21.205650 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:21.205897 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:21.205900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:21.206105 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:21.206210 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:21.206215 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.206996 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.206999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:21.207620 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:21.207630 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.208143 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.208146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:21.208215 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:21.214348 (+ 6133us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:21.214365 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:21.216599 (+ 2234us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":99,"threads_started":1}
W20260810 14:31:21.216907 11722 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:21.205317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:56861 (local address 127.1.206.126:34409)
0810 14:31:21.205637 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:21.205641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:21.205657 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:31:21.205736 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:21.205739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:21.205784 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:21.205855 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:21.206346 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.206887 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.207768 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.208017 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.208108 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:21.216763 (+ 8655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:56861: BlockingRecv error: recv got EOF from 127.1.206.65:56861 (error 108)
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":67,"threads_started":1}
Aug 10 14:31:21 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:21 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:31:21.413600 11722 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:21.407482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:55021 (local address 127.1.206.126:34409)
0810 14:31:21.407650 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:21.407654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:21.407673 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:31:21.407829 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:21.407831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:21.407877 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:21.407947 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:21.408532 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.409077 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.409919 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.410140 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.410219 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:21.413478 (+ 3259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:55021: BlockingRecv error: recv got EOF from 127.1.206.66:55021 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 14:31:21.413671 11723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:21.407320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:55021)
0810 14:31:21.407605 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:21.407622 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:21.407724 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:21.408030 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:21.408033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:21.408290 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:21.408400 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:21.408406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.409204 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.409207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:21.409804 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:21.409813 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.410294 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.410297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:21.410365 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:21.411062 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:21.411074 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:21.413297 (+ 2223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":73,"threads_started":1}
Aug 10 14:31:21 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:21 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.67@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:21.620707 11724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:21.614681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.67:36771)
0810 14:31:21.615011 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:21.615025 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:21.615169 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:21.615456 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:21.615459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:21.615685 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:21.615781 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:21.615786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.616864 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.616868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:21.617595 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:21.617605 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.618035 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.618037 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:21.618099 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:21.618686 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:21.618706 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:21.620576 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":132,"threads_started":1}
W20260810 14:31:21.620850 11722 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:21.614749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:36771 (local address 127.1.206.126:34409)
0810 14:31:21.614915 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:21.614920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:21.615100 (+ 180us) server_negotiation.cc:407] Connection header received
0810 14:31:21.615285 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:21.615290 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:21.615347 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:21.615436 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:21.615901 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.616679 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.617710 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:21.617932 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:21.618011 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:21.620712 (+ 2701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.67:36771: BlockingRecv error: recv got EOF from 127.1.206.67:36771 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 14:31:22 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:22 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.65@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:22.224086 11725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:22.217833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.65:55681)
0810 14:31:22.218150 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:22.218167 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:22.218261 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:22.218522 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:22.218524 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:22.218726 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:22.218826 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:22.218832 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.219648 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.219651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:22.220239 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:22.220248 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.220816 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.220819 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:22.220894 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:22.221425 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:22.221439 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:22.223863 (+ 2424us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":87,"threads_started":1}
W20260810 14:31:22.224354 11726 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:22.217967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:55681 (local address 127.1.206.126:34409)
0810 14:31:22.218204 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:22.218209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:22.218224 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:31:22.218356 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:22.218359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:22.218404 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:22.218482 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:22.218946 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.219502 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.220437 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.220688 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.220779 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:22.224129 (+ 3350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.65:55681: BlockingRecv error: recv got EOF from 127.1.206.65:55681 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":65,"threads_started":1}
Aug 10 14:31:22 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:31:22 dist-test-slave-0b58 krb5kdc[10578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.206.66@KRBTEST.COM for oryx/127.1.206.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:31:22.420711 11727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:22.414590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34409 (local address 127.1.206.66:36857)
0810 14:31:22.414934 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:22.414951 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:22.415093 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:22.415406 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:22.415408 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:22.415632 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:22.415724 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:22.415730 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.416568 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.416573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:22.417165 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:22.417174 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.417647 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.417651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:22.417742 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:22.418360 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:22.418370 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:22.420514 (+ 2144us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.206.126:34409: Server oryx/127.1.206.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":92,"threads_started":1}
W20260810 14:31:22.420783 11726 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:22.414728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:36857 (local address 127.1.206.126:34409)
0810 14:31:22.414914 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:22.414918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:22.415038 (+ 120us) server_negotiation.cc:407] Connection header received
0810 14:31:22.415203 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:22.415206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:22.415285 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:22.415382 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:22.415855 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.416455 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.417297 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.417525 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.417641 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:22.420659 (+ 3018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.206.66:36857: BlockingRecv error: recv got EOF from 127.1.206.66:36857 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 14:31:22.507136 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 11207
I20260810 14:31:22.518182 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 11370
I20260810 14:31:22.526340 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 11508
I20260810 14:31:22.535437 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 11133
2026-08-10T14:31:22Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18233 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T14:31:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:31:22Z Disabled control of system clock
I20260810 14:31:22.572494 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45875
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:45875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 14:31:22.692530 11733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:22.692854 11733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:22.692891 11733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:22.697170 11733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:31:22.697259 11733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:22.697275 11733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:22.697293 11733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:31:22.697309 11733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:31:22.702344 11733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:45875
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:22.703528 11733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:22.705029 11733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:22.714082 11738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:22.714084 11739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:22.714304 11733 server_base.cc:1034] running on GCE node
W20260810 14:31:22.714439 11741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:22.715106 11733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:22.716423 11733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:22.717604 11733 hybrid_clock.cc:648] HybridClock initialized: now 1786372282717585 us; error 37 us; skew 500 ppm
I20260810 14:31:22.719668 11733 webserver.cc:460] Webserver started at http://127.1.206.126:44083/ using document root <none> and password file <none>
I20260810 14:31:22.720382 11733 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:22.720468 11733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:22.720660 11733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:22.722889 11733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "c3866b809b6f48a3b37d23304d1a6612"
format_stamp: "Formatted at 2026-08-10 14:31:22 on dist-test-slave-0b58"
server_key: "db7620c6b1234e2ea37f1b90f9850b54"
server_key_iv: "bced4afa88db445ad87f67c1888d16ad"
server_key_version: "encryptionkey@0"
I20260810 14:31:22.723466 11733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "c3866b809b6f48a3b37d23304d1a6612"
format_stamp: "Formatted at 2026-08-10 14:31:22 on dist-test-slave-0b58"
server_key: "db7620c6b1234e2ea37f1b90f9850b54"
server_key_iv: "bced4afa88db445ad87f67c1888d16ad"
server_key_version: "encryptionkey@0"
I20260810 14:31:22.727617 11733 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:31:22.730451 11747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:22.731956 11733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 14:31:22.732089 11733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "c3866b809b6f48a3b37d23304d1a6612"
format_stamp: "Formatted at 2026-08-10 14:31:22 on dist-test-slave-0b58"
server_key: "db7620c6b1234e2ea37f1b90f9850b54"
server_key_iv: "bced4afa88db445ad87f67c1888d16ad"
server_key_version: "encryptionkey@0"
I20260810 14:31:22.732203 11733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:22.767011 11733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:22.767901 11733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:22.768074 11733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:22.775926 11733 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:45875
I20260810 14:31:22.775954 11803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:45875 every 8 connection(s)
I20260810 14:31:22.777083 11733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:31:22.779994 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 11733
I20260810 14:31:22.780134 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:31:22.780508 1849 external_mini_cluster.cc:1428] Setting key f15c0aec9b096404895531bad3af217e
I20260810 14:31:22.781284 11804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:22.789088 11804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612: Bootstrap starting.
I20260810 14:31:22.790959 11807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:22.782205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46500 (local address 127.1.206.126:45875)
0810 14:31:22.782884 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:22.782901 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:22.782938 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:31:22.783649 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:22.783668 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:22.784079 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:22.784460 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:22.784968 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.785998 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.787274 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:22.787813 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:22.787946 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:22.788944 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:22.788949 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:22.788963 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:22.789486 (+ 523us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:22.789549 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:22.789572 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:22.789656 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:22.789852 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 14:31:22.790184 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":154,"threads_started":1}
I20260810 14:31:22.791749 11804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:22.792627 11804 log.cc:824] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:22.794667 11804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612: No bootstrap required, opened a new log
I20260810 14:31:22.798664 11804 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3866b809b6f48a3b37d23304d1a6612" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45875 } }
I20260810 14:31:22.799000 11804 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:22.799093 11804 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3866b809b6f48a3b37d23304d1a6612, State: Initialized, Role: FOLLOWER
I20260810 14:31:22.799587 11804 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3866b809b6f48a3b37d23304d1a6612" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45875 } }
I20260810 14:31:22.799780 11804 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:31:22.799878 11804 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:31:22.800025 11804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:22.801200 11804 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3866b809b6f48a3b37d23304d1a6612" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45875 } }
I20260810 14:31:22.801611 11804 leader_election.cc:302] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3866b809b6f48a3b37d23304d1a6612; no voters:
I20260810 14:31:22.801983 11804 leader_election.cc:288] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:31:22.802140 11809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:22.802424 11809 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [term 1 LEADER]: Becoming Leader. State: Replica: c3866b809b6f48a3b37d23304d1a6612, State: Running, Role: LEADER
I20260810 14:31:22.802750 11809 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3866b809b6f48a3b37d23304d1a6612" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45875 } }
I20260810 14:31:22.803421 11804 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:31:22.804838 11810 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3866b809b6f48a3b37d23304d1a6612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3866b809b6f48a3b37d23304d1a6612" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45875 } } }
I20260810 14:31:22.804905 11811 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3866b809b6f48a3b37d23304d1a6612. Latest consensus state: current_term: 1 leader_uuid: "c3866b809b6f48a3b37d23304d1a6612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3866b809b6f48a3b37d23304d1a6612" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45875 } } }
I20260810 14:31:22.804992 11811 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:22.804992 11810 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:22.805436 11818 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:31:22.808602 11818 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:31:22.814920 11818 catalog_manager.cc:1347] Generated new cluster ID: 2e8728e2ed00493f9b7fd4c822590172
I20260810 14:31:22.815038 11818 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:31:22.822469 11818 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:31:22.823477 11818 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:31:22.834796 11818 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3866b809b6f48a3b37d23304d1a6612: Generated new TSK 0
I20260810 14:31:22.835649 11818 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:31:22.840658 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45875
--builtin_ntp_servers=127.1.206.84:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 14:31:22.961130 11829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:22.961436 11829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:22.961474 11829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:22.965911 11829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:22.965991 11829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:22.966049 11829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:31:22.971403 11829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:22.972703 11829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:22.974238 11829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:22.984781 11837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:22.984782 11835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:22.984791 11834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:22.984901 11829 server_base.cc:1034] running on GCE node
I20260810 14:31:22.985637 11829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:22.986377 11829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:22.987639 11829 hybrid_clock.cc:648] HybridClock initialized: now 1786372282987568 us; error 58 us; skew 500 ppm
I20260810 14:31:22.990054 11829 webserver.cc:460] Webserver started at http://127.1.206.65:42891/ using document root <none> and password file <none>
I20260810 14:31:22.991014 11829 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:22.991170 11829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:22.991465 11829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:22.993844 11829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "5d88d77dcf5a419aaf01fbf0c6704ef8"
format_stamp: "Formatted at 2026-08-10 14:31:22 on dist-test-slave-0b58"
server_key: "701379be5c281b313dae253aae98d06d"
server_key_iv: "93c5078b2e2b348290a1896e5fc41bee"
server_key_version: "encryptionkey@0"
I20260810 14:31:22.994470 11829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "5d88d77dcf5a419aaf01fbf0c6704ef8"
format_stamp: "Formatted at 2026-08-10 14:31:22 on dist-test-slave-0b58"
server_key: "701379be5c281b313dae253aae98d06d"
server_key_iv: "93c5078b2e2b348290a1896e5fc41bee"
server_key_version: "encryptionkey@0"
I20260810 14:31:22.998605 11829 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:31:23.001516 11843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.002941 11829 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:31:23.003110 11829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "5d88d77dcf5a419aaf01fbf0c6704ef8"
format_stamp: "Formatted at 2026-08-10 14:31:22 on dist-test-slave-0b58"
server_key: "701379be5c281b313dae253aae98d06d"
server_key_iv: "93c5078b2e2b348290a1896e5fc41bee"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.003309 11829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:23.025540 11829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:23.026350 11829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:23.026566 11829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:23.027207 11829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:23.028203 11829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:23.028276 11829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.028366 11829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:23.028414 11829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.038331 11829 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:45915
I20260810 14:31:23.038378 11966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:45915 every 8 connection(s)
I20260810 14:31:23.039389 11829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:31:23.049304 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 11829
I20260810 14:31:23.049437 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:31:23.049531 11807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.041334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:57625 (local address 127.1.206.126:45875)
0810 14:31:23.041486 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:23.041489 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:23.042473 (+ 984us) server_negotiation.cc:407] Connection header received
0810 14:31:23.043978 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:23.043982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:23.044054 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:23.044163 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:23.045145 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.045705 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.046909 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.047374 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.047525 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:23.048899 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:23.048902 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:23.048904 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:23.048919 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:23.048960 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:23.048974 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:23.049061 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:23.049264 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 14:31:23.049353 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:31:23.049820 1849 external_mini_cluster.cc:1428] Setting key 5a3953947602311b17840f1084b2fa47
I20260810 14:31:23.050706 11969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.041640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:45875 (local address 127.1.206.65:57625)
0810 14:31:23.042314 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:23.042358 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:23.043736 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:23.044384 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:23.044391 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:23.044477 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:23.044991 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:23.045004 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.045855 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.045858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:23.046765 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:23.046774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.047577 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.047582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:23.047772 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:23.048556 (+ 784us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:31:23.048558 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:23.048603 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:31:23.048677 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:23.049083 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:23.049094 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:23.049099 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:31:23.049223 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 14:31:23.049591 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":130,"threads_started":1}
I20260810 14:31:23.052014 11967 heartbeater.cc:347] Connected to a master server at 127.1.206.126:45875
I20260810 14:31:23.052068 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45875
--builtin_ntp_servers=127.1.206.84:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 14:31:23.052338 11967 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:23.053057 11967 heartbeater.cc:511] Master 127.1.206.126:45875 requested a full tablet report, sending...
I20260810 14:31:23.054883 11766 ts_manager.cc:194] Registered new tserver with Master: 5d88d77dcf5a419aaf01fbf0c6704ef8 (127.1.206.65:45915)
I20260810 14:31:23.056663 11766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.65:57625
W20260810 14:31:23.172382 11970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:23.172663 11970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:23.172703 11970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:23.176779 11970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:23.176841 11970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:23.176898 11970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:31:23.181857 11970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:23.182919 11970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:23.184391 11970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:23.194175 11977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.194178 11976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.194178 11979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:23.194545 11970 server_base.cc:1034] running on GCE node
I20260810 14:31:23.194988 11970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:23.195655 11970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:23.196856 11970 hybrid_clock.cc:648] HybridClock initialized: now 1786372283196840 us; error 28 us; skew 500 ppm
I20260810 14:31:23.198750 11970 webserver.cc:460] Webserver started at http://127.1.206.66:45549/ using document root <none> and password file <none>
I20260810 14:31:23.199368 11970 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:23.199463 11970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:23.199702 11970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:23.201900 11970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "5dc4dc5b8355444cbb9f7987b0b5579b"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "75792d09d9470b6ae00d5768a858a436"
server_key_iv: "9fe9b56c948e34a8f3b94615f08a896c"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.202497 11970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "5dc4dc5b8355444cbb9f7987b0b5579b"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "75792d09d9470b6ae00d5768a858a436"
server_key_iv: "9fe9b56c948e34a8f3b94615f08a896c"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.206561 11970 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:31:23.209231 11985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.210444 11970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:31:23.210582 11970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "5dc4dc5b8355444cbb9f7987b0b5579b"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "75792d09d9470b6ae00d5768a858a436"
server_key_iv: "9fe9b56c948e34a8f3b94615f08a896c"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.210703 11970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:23.225039 11970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:23.226141 11970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:23.226441 11970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:23.227193 11970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:23.228447 11970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:23.228520 11970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.228590 11970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:23.228621 11970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.237893 11970 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:36319
I20260810 14:31:23.237913 12105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:36319 every 8 connection(s)
I20260810 14:31:23.238874 11970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:31:23.240744 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 11970
I20260810 14:31:23.240877 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:31:23.241202 1849 external_mini_cluster.cc:1428] Setting key 5f530723f36d2140ca277d4282728e1c
I20260810 14:31:23.243372 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45875
--builtin_ntp_servers=127.1.206.84:35919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 14:31:23.250034 11807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.241687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:59267 (local address 127.1.206.126:45875)
0810 14:31:23.241889 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:23.241895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:23.242602 (+ 707us) server_negotiation.cc:407] Connection header received
0810 14:31:23.244175 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:23.244179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:23.244239 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:23.244350 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:23.245509 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.246039 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.247397 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.247850 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.247979 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:23.249396 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:23.249402 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:23.249408 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:23.249426 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:23.249458 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:23.249473 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:23.249578 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:23.249718 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 14:31:23.249811 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 14:31:23.250932 12108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.241549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:45875 (local address 127.1.206.66:59267)
0810 14:31:23.242427 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:23.242488 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:23.243910 (+ 1422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:23.244597 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:23.244604 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:23.244693 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:23.245339 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:23.245361 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.246191 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.246195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:23.247250 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:23.247261 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.248057 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.248064 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:23.248230 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:23.249105 (+ 875us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:31:23.249106 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:23.249147 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:31:23.249214 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:23.249572 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:23.249579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:23.249583 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:31:23.249681 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 14:31:23.249930 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":174,"threads_started":1}
I20260810 14:31:23.252205 12106 heartbeater.cc:347] Connected to a master server at 127.1.206.126:45875
I20260810 14:31:23.252542 12106 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:23.253274 12106 heartbeater.cc:511] Master 127.1.206.126:45875 requested a full tablet report, sending...
I20260810 14:31:23.254515 11766 ts_manager.cc:194] Registered new tserver with Master: 5dc4dc5b8355444cbb9f7987b0b5579b (127.1.206.66:36319)
I20260810 14:31:23.255108 11766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.66:59267
W20260810 14:31:23.361824 12109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:23.362200 12109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:23.362277 12109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:23.366603 12109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:23.366688 12109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:23.366746 12109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:31:23.371858 12109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:35919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:45875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:23.373121 12109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:23.374607 12109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:23.384758 12114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.384775 12115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.384758 12117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:23.385296 12109 server_base.cc:1034] running on GCE node
I20260810 14:31:23.385686 12109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:23.386370 12109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:23.387542 12109 hybrid_clock.cc:648] HybridClock initialized: now 1786372283387523 us; error 30 us; skew 500 ppm
I20260810 14:31:23.389570 12109 webserver.cc:460] Webserver started at http://127.1.206.67:38595/ using document root <none> and password file <none>
I20260810 14:31:23.390201 12109 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:23.390272 12109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:23.390507 12109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:23.392863 12109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "c12bb2e7de8c4de182bd96733a1212d2"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "66706e9603b95c90bc8d1474d6516cbe"
server_key_iv: "792235cd516f20eb39b791865fff78d1"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.393499 12109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "c12bb2e7de8c4de182bd96733a1212d2"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "66706e9603b95c90bc8d1474d6516cbe"
server_key_iv: "792235cd516f20eb39b791865fff78d1"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.397789 12109 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:31:23.400882 12123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.402328 12109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:31:23.402500 12109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "c12bb2e7de8c4de182bd96733a1212d2"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "66706e9603b95c90bc8d1474d6516cbe"
server_key_iv: "792235cd516f20eb39b791865fff78d1"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.402647 12109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:23.421006 12109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:23.421850 12109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:23.422084 12109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:23.422763 12109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:23.423854 12109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:23.423933 12109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.424015 12109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:23.424065 12109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.433877 12109 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:44755
I20260810 14:31:23.433903 12243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:44755 every 8 connection(s)
I20260810 14:31:23.434998 12109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:31:23.441896 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 12109
I20260810 14:31:23.442041 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:31:23.442364 1849 external_mini_cluster.cc:1428] Setting key 4c5a44bc299376ba96a73e5efc7b4694
I20260810 14:31:23.445858 11807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.437084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:41017 (local address 127.1.206.126:45875)
0810 14:31:23.437318 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:23.437324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:23.438589 (+ 1265us) server_negotiation.cc:407] Connection header received
0810 14:31:23.440002 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:23.440005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:23.440058 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:23.440144 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:23.441204 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.441784 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.443534 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.443883 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.444021 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:23.445318 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:23.445321 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:23.445323 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:23.445336 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:23.445358 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:23.445365 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:23.445428 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:23.445674 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 14:31:23.445736 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260810 14:31:23.446808 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.437668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:45875 (local address 127.1.206.67:41017)
0810 14:31:23.438417 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:23.438461 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:23.439787 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:23.440428 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:23.440435 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:23.440524 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:23.441049 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:23.441063 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.441953 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.441960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:23.443414 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:23.443429 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:23.444064 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:23.444067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:23.444235 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:23.445041 (+ 806us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:31:23.445043 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:23.445090 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:31:23.445168 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:23.445448 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:23.445455 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:23.445461 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:31:23.445569 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 14:31:23.445842 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":132,"threads_started":1}
I20260810 14:31:23.448096 12244 heartbeater.cc:347] Connected to a master server at 127.1.206.126:45875
I20260810 14:31:23.448412 12244 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:23.448942 12244 heartbeater.cc:511] Master 127.1.206.126:45875 requested a full tablet report, sending...
I20260810 14:31:23.450029 11766 ts_manager.cc:194] Registered new tserver with Master: c12bb2e7de8c4de182bd96733a1212d2 (127.1.206.67:44755)
I20260810 14:31:23.450676 11766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.67:41017
I20260810 14:31:23.456892 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 14:31:23.459767 11807 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:23.458905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46508 (local address 127.1.206.126:45875)
0810 14:31:23.459045 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:23.459049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:23.459188 (+ 139us) server_negotiation.cc:407] Connection header received
0810 14:31:23.459312 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:23.459314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:23.459355 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:23.459423 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:23.459648 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46508: BlockingRecv error: recv got EOF from 127.0.0.1:46508 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:31:23.460405 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 11829
I20260810 14:31:23.468474 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 11970
I20260810 14:31:23.478363 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 12109
I20260810 14:31:23.485617 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 11733
2026-08-10T14:31:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (946 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T14:31:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:31:23Z Disabled control of system clock
I20260810 14:31:23.519441 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:38075
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:38075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 14:31:23.637521 12256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:23.637804 12256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:23.637842 12256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:23.641957 12256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:31:23.642021 12256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:23.642037 12256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:23.642055 12256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:31:23.642071 12256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:31:23.647135 12256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:38075
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:38075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:23.648399 12256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:23.649868 12256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:23.660455 12263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.660490 12264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.660457 12266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:23.660825 12256 server_base.cc:1034] running on GCE node
I20260810 14:31:23.661568 12256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:23.662741 12256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:23.663955 12256 hybrid_clock.cc:648] HybridClock initialized: now 1786372283663942 us; error 30 us; skew 500 ppm
I20260810 14:31:23.666255 12256 webserver.cc:460] Webserver started at http://127.1.206.126:45989/ using document root <none> and password file <none>
I20260810 14:31:23.666867 12256 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:23.666960 12256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:23.667264 12256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:23.670289 12256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "8f61da997172484fa85b799a4e1285a1"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "be8846b6d277aca7cdcec22bbfae3f1a"
server_key_iv: "9e10dbd1c6c8c1a99a1023d0e411e343"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.670905 12256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "8f61da997172484fa85b799a4e1285a1"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "be8846b6d277aca7cdcec22bbfae3f1a"
server_key_iv: "9e10dbd1c6c8c1a99a1023d0e411e343"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.674976 12256 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:31:23.677784 12273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.679095 12256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:31:23.679250 12256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "8f61da997172484fa85b799a4e1285a1"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "be8846b6d277aca7cdcec22bbfae3f1a"
server_key_iv: "9e10dbd1c6c8c1a99a1023d0e411e343"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.679384 12256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:23.684188 12256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:23.684846 12256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:23.685042 12256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:23.692507 12256 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:38075
I20260810 14:31:23.692518 12328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:38075 every 8 connection(s)
I20260810 14:31:23.693511 12256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:31:23.696542 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 12256
I20260810 14:31:23.696689 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:31:23.696743 12329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:23.697006 1849 external_mini_cluster.cc:1428] Setting key 94a26c9cf85d868de7e4e80195841530
I20260810 14:31:23.703313 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.698476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51356 (local address 127.1.206.126:38075)
0810 14:31:23.699256 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:23.699276 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:23.699322 (+ 46us) server_negotiation.cc:407] Connection header received
0810 14:31:23.700183 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:23.700208 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:23.700684 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:23.701051 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:23.701793 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:23.701799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:23.701812 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:23.701825 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:23.701892 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:23.701915 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:23.702059 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:23.702136 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 14:31:23.702380 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":200,"threads_started":1}
I20260810 14:31:23.704392 12329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1: Bootstrap starting.
I20260810 14:31:23.706818 12329 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:23.707587 12329 log.cc:824] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:23.709882 12329 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1: No bootstrap required, opened a new log
I20260810 14:31:23.714099 12329 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f61da997172484fa85b799a4e1285a1" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38075 } }
I20260810 14:31:23.714398 12329 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:23.714483 12329 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f61da997172484fa85b799a4e1285a1, State: Initialized, Role: FOLLOWER
I20260810 14:31:23.714974 12329 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f61da997172484fa85b799a4e1285a1" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38075 } }
I20260810 14:31:23.715138 12329 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:31:23.715233 12329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:31:23.715344 12329 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:23.716845 12329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f61da997172484fa85b799a4e1285a1" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38075 } }
I20260810 14:31:23.717238 12329 leader_election.cc:302] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f61da997172484fa85b799a4e1285a1; no voters:
I20260810 14:31:23.717582 12329 leader_election.cc:288] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:31:23.717754 12334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:23.718014 12334 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [term 1 LEADER]: Becoming Leader. State: Replica: 8f61da997172484fa85b799a4e1285a1, State: Running, Role: LEADER
I20260810 14:31:23.718346 12334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f61da997172484fa85b799a4e1285a1" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38075 } }
I20260810 14:31:23.718989 12329 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:31:23.720168 12336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f61da997172484fa85b799a4e1285a1. Latest consensus state: current_term: 1 leader_uuid: "8f61da997172484fa85b799a4e1285a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f61da997172484fa85b799a4e1285a1" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38075 } } }
I20260810 14:31:23.720350 12336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:23.720788 12343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:31:23.721355 12335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f61da997172484fa85b799a4e1285a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f61da997172484fa85b799a4e1285a1" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38075 } } }
I20260810 14:31:23.721509 12335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:23.723729 12343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:31:23.729466 12343 catalog_manager.cc:1347] Generated new cluster ID: 14a6a76054664e85aaf0138b1990e7cb
I20260810 14:31:23.729545 12343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:31:23.756053 12343 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:31:23.756511 12343 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:31:23.761937 12343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f61da997172484fa85b799a4e1285a1: Generated new TSK 0
I20260810 14:31:23.762637 12343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:31:23.770223 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38075
--builtin_ntp_servers=127.1.206.84:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 14:31:23.887190 12354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:23.887475 12354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:23.887519 12354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:23.891696 12354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:23.891770 12354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:23.891835 12354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:31:23.896814 12354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:23.897960 12354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:23.899387 12354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:23.909644 12361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.909658 12363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:23.909644 12360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:23.910200 12354 server_base.cc:1034] running on GCE node
I20260810 14:31:23.910712 12354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:23.911463 12354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:23.912668 12354 hybrid_clock.cc:648] HybridClock initialized: now 1786372283912622 us; error 61 us; skew 500 ppm
I20260810 14:31:23.914772 12354 webserver.cc:460] Webserver started at http://127.1.206.65:44577/ using document root <none> and password file <none>
I20260810 14:31:23.915396 12354 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:23.915498 12354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:23.915742 12354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:23.918293 12354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "391e3d30fa284ee3b946b0c664f58c12"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "31230da42d0d3959cdd5f31ac43f84e2"
server_key_iv: "26cd81a0fcff103cde5a28495b812d5a"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.918979 12354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "391e3d30fa284ee3b946b0c664f58c12"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "31230da42d0d3959cdd5f31ac43f84e2"
server_key_iv: "26cd81a0fcff103cde5a28495b812d5a"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.923346 12354 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:31:23.926195 12369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.927561 12354 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:31:23.927742 12354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "391e3d30fa284ee3b946b0c664f58c12"
format_stamp: "Formatted at 2026-08-10 14:31:23 on dist-test-slave-0b58"
server_key: "31230da42d0d3959cdd5f31ac43f84e2"
server_key_iv: "26cd81a0fcff103cde5a28495b812d5a"
server_key_version: "encryptionkey@0"
I20260810 14:31:23.927896 12354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:23.933398 12354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:23.934134 12354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:23.934370 12354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:23.935009 12354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:23.936069 12354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:23.936151 12354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:23.936295 12354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:23.936358 12354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260810 14:31:23.945734 12354 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:37845
I20260810 14:31:23.945796 12494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:37845 every 8 connection(s)
I20260810 14:31:23.946835 12354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:31:23.947778 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 12354
I20260810 14:31:23.947922 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:31:23.948411 1849 external_mini_cluster.cc:1428] Setting key 1b09278e07271373e7ffd930ee15aec8
I20260810 14:31:23.950968 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38075
--builtin_ntp_servers=127.1.206.84:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 14:31:23.954028 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.948958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:41481 (local address 127.1.206.126:38075)
0810 14:31:23.949114 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:23.949118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:23.950480 (+ 1362us) server_negotiation.cc:407] Connection header received
0810 14:31:23.952018 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:23.952024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:23.952077 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:23.952174 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:23.953554 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:23.953557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:23.953559 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:23.953572 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:23.953593 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:23.953602 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:23.953682 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:23.953878 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 14:31:23.953920 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:31:23.955091 12497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:23.949421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:38075 (local address 127.1.206.65:41481)
0810 14:31:23.950287 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:23.950355 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:23.951786 (+ 1431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:23.952402 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:23.952409 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:23.952507 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:23.953174 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:31:23.953178 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:23.953246 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:31:23.953368 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:23.953700 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:23.953715 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:23.953723 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:31:23.953936 (+ 213us) client_negotiation.cc:240] Negotiation successful
0810 14:31:23.954224 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":120,"threads_started":1}
I20260810 14:31:23.956483 12495 heartbeater.cc:347] Connected to a master server at 127.1.206.126:38075
I20260810 14:31:23.956743 12495 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:23.957176 12495 heartbeater.cc:511] Master 127.1.206.126:38075 requested a full tablet report, sending...
I20260810 14:31:23.959035 12290 ts_manager.cc:194] Registered new tserver with Master: 391e3d30fa284ee3b946b0c664f58c12 (127.1.206.65:37845)
W20260810 14:31:24.069103 12498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:24.069381 12498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:24.069463 12498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:24.073601 12498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:24.073669 12498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:24.073729 12498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:31:24.078665 12498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:24.079908 12498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:24.081437 12498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:24.091132 12503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:24.091131 12504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:24.091171 12506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:24.092057 12498 server_base.cc:1034] running on GCE node
I20260810 14:31:24.092525 12498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:24.093171 12498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:24.094378 12498 hybrid_clock.cc:648] HybridClock initialized: now 1786372284094342 us; error 51 us; skew 500 ppm
I20260810 14:31:24.096187 12498 webserver.cc:460] Webserver started at http://127.1.206.66:39761/ using document root <none> and password file <none>
I20260810 14:31:24.096820 12498 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:24.096915 12498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:24.097152 12498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:24.099225 12498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "02956601bccc4beba2d9bc794c6fe844"
format_stamp: "Formatted at 2026-08-10 14:31:24 on dist-test-slave-0b58"
server_key: "5b81d3c69c926152534ada7953eac698"
server_key_iv: "1cd209c5b540e4569084343ab6bbbbe0"
server_key_version: "encryptionkey@0"
I20260810 14:31:24.099833 12498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "02956601bccc4beba2d9bc794c6fe844"
format_stamp: "Formatted at 2026-08-10 14:31:24 on dist-test-slave-0b58"
server_key: "5b81d3c69c926152534ada7953eac698"
server_key_iv: "1cd209c5b540e4569084343ab6bbbbe0"
server_key_version: "encryptionkey@0"
I20260810 14:31:24.103796 12498 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 14:31:24.106568 12512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:24.107828 12498 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:24.107966 12498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "02956601bccc4beba2d9bc794c6fe844"
format_stamp: "Formatted at 2026-08-10 14:31:24 on dist-test-slave-0b58"
server_key: "5b81d3c69c926152534ada7953eac698"
server_key_iv: "1cd209c5b540e4569084343ab6bbbbe0"
server_key_version: "encryptionkey@0"
I20260810 14:31:24.108086 12498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:24.113044 12498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:24.113713 12498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:24.113901 12498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:24.114456 12498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:24.115397 12498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:24.115476 12498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:24.115564 12498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:24.115618 12498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:24.124971 12498 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:40727
I20260810 14:31:24.125006 12643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:40727 every 8 connection(s)
I20260810 14:31:24.125924 12498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:31:24.130694 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 12498
I20260810 14:31:24.130864 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:31:24.131175 1849 external_mini_cluster.cc:1428] Setting key 71abf9ecb6b84b787960f05379c0ecb2
I20260810 14:31:24.132483 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:24.127864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:52825 (local address 127.1.206.126:38075)
0810 14:31:24.128025 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:24.128031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:24.129242 (+ 1211us) server_negotiation.cc:407] Connection header received
0810 14:31:24.130560 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:24.130563 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:24.130610 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:24.130698 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:24.131970 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:24.131973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:24.131976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:24.131995 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:24.132015 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:24.132023 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:24.132123 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:24.132298 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 14:31:24.132346 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:31:24.133361 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38075
--builtin_ntp_servers=127.1.206.84:40931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 14:31:24.133540 12646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:24.128410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:38075 (local address 127.1.206.66:52825)
0810 14:31:24.129079 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:24.129121 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:24.130340 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:24.130915 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:24.130922 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:24.131041 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:24.131701 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:31:24.131702 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:24.131743 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:31:24.131815 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:24.132109 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:24.132118 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:24.132124 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:31:24.132343 (+ 219us) client_negotiation.cc:240] Negotiation successful
0810 14:31:24.132729 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":122,"threads_started":1}
I20260810 14:31:24.134778 12644 heartbeater.cc:347] Connected to a master server at 127.1.206.126:38075
I20260810 14:31:24.135008 12644 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:24.135432 12644 heartbeater.cc:511] Master 127.1.206.126:38075 requested a full tablet report, sending...
I20260810 14:31:24.136494 12290 ts_manager.cc:194] Registered new tserver with Master: 02956601bccc4beba2d9bc794c6fe844 (127.1.206.66:40727)
W20260810 14:31:24.251797 12647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:24.252084 12647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:24.252126 12647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:24.256966 12647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:24.257035 12647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:24.257097 12647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:31:24.262545 12647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:24.263757 12647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:24.265275 12647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:24.275580 12652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:24.275612 12653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:24.275591 12655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:24.275591 12647 server_base.cc:1034] running on GCE node
I20260810 14:31:24.276412 12647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:24.277091 12647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:24.278286 12647 hybrid_clock.cc:648] HybridClock initialized: now 1786372284278270 us; error 31 us; skew 500 ppm
I20260810 14:31:24.280566 12647 webserver.cc:460] Webserver started at http://127.1.206.67:39131/ using document root <none> and password file <none>
I20260810 14:31:24.281205 12647 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:24.281277 12647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:24.281510 12647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:24.283892 12647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "eb3c21e70ec9422aaa33e96f9478b390"
format_stamp: "Formatted at 2026-08-10 14:31:24 on dist-test-slave-0b58"
server_key: "99a29ac35e9cbce1b3797b23c9b78624"
server_key_iv: "8ccd442d1441e1c613b97e6d9c54f9a6"
server_key_version: "encryptionkey@0"
I20260810 14:31:24.284533 12647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "eb3c21e70ec9422aaa33e96f9478b390"
format_stamp: "Formatted at 2026-08-10 14:31:24 on dist-test-slave-0b58"
server_key: "99a29ac35e9cbce1b3797b23c9b78624"
server_key_iv: "8ccd442d1441e1c613b97e6d9c54f9a6"
server_key_version: "encryptionkey@0"
I20260810 14:31:24.288546 12647 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:31:24.291356 12661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:24.292768 12647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:31:24.292905 12647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "eb3c21e70ec9422aaa33e96f9478b390"
format_stamp: "Formatted at 2026-08-10 14:31:24 on dist-test-slave-0b58"
server_key: "99a29ac35e9cbce1b3797b23c9b78624"
server_key_iv: "8ccd442d1441e1c613b97e6d9c54f9a6"
server_key_version: "encryptionkey@0"
I20260810 14:31:24.293040 12647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:24.298029 12647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:24.298698 12647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:24.298897 12647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:24.299494 12647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:24.300534 12647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:24.300585 12647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:24.300650 12647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:24.300683 12647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:24.309779 12647 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:42973
I20260810 14:31:24.309863 12782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:42973 every 8 connection(s)
I20260810 14:31:24.310806 12647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:31:24.311132 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 12647
I20260810 14:31:24.311295 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:31:24.311699 1849 external_mini_cluster.cc:1428] Setting key b388b0e974b696cb99535109e39dac0e
I20260810 14:31:24.317961 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:24.313262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:35937 (local address 127.1.206.126:38075)
0810 14:31:24.313417 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:24.313422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:24.314702 (+ 1280us) server_negotiation.cc:407] Connection header received
0810 14:31:24.316063 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:24.316067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:24.316112 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:24.316189 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:24.317395 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:24.317398 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:24.317401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:31:24.317414 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:24.317446 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:31:24.317455 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:24.317596 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:24.317765 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 14:31:24.317817 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 14:31:24.318950 12785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:24.313752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:38075 (local address 127.1.206.67:35937)
0810 14:31:24.314558 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:24.314601 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:24.315847 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:24.316395 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:24.316403 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:24.316497 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:24.317079 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:31:24.317080 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:24.317123 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:31:24.317197 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:24.317590 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:24.317601 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:24.317609 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:31:24.317810 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 14:31:24.318075 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":142,"threads_started":1}
I20260810 14:31:24.320400 12783 heartbeater.cc:347] Connected to a master server at 127.1.206.126:38075
I20260810 14:31:24.320710 12783 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:24.321269 12783 heartbeater.cc:511] Master 127.1.206.126:38075 requested a full tablet report, sending...
I20260810 14:31:24.322479 12290 ts_manager.cc:194] Registered new tserver with Master: eb3c21e70ec9422aaa33e96f9478b390 (127.1.206.67:42973)
I20260810 14:31:24.326136 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 14:31:24.329209 12332 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:31:24.328162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51366 (local address 127.1.206.126:38075)
0810 14:31:24.328355 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:24.328360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:24.328527 (+ 167us) server_negotiation.cc:407] Connection header received
0810 14:31:24.328708 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:24.328711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:24.328749 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:24.328844 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:24.329076 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51366: BlockingRecv error: recv got EOF from 127.0.0.1:51366 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:31:24.329454 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 12354
I20260810 14:31:24.337430 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 12498
I20260810 14:31:24.345994 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 12647
I20260810 14:31:24.353412 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 12256
2026-08-10T14:31:24Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (867 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:31:24 dist-test-slave-0b58 krb5kdc[12793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:31:24 dist-test-slave-0b58 krb5kdc[12793](info): set up 2 sockets
Aug 10 14:31:24 dist-test-slave-0b58 krb5kdc[12793](info): commencing operation
krb5kdc: starting...
W20260810 14:31:25.456589 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:31:25 dist-test-slave-0b58 krb5kdc[12793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:31:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:31:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:31:25.591369 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39427
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39427
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:25.706660 12808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:25.706929 12808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:25.706969 12808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:25.711023 12808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:31:25.711097 12808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:25.711117 12808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:25.711139 12808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:31:25.711154 12808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:31:25.716495 12808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:25.717566 12808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:25.718547 12808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:25.727246 12814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:25.727203 12816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:25.727298 12813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:25.727685 12808 server_base.cc:1034] running on GCE node
I20260810 14:31:25.728358 12808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:25.729496 12808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:25.730716 12808 hybrid_clock.cc:648] HybridClock initialized: now 1786372285730685 us; error 54 us; skew 500 ppm
Aug 10 14:31:25 dist-test-slave-0b58 krb5kdc[12793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:25.733579 12808 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:31:25.734513 12808 webserver.cc:460] Webserver started at http://127.1.206.126:39389/ using document root <none> and password file <none>
I20260810 14:31:25.735095 12808 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:25.735194 12808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:25.735437 12808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:25.737627 12808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "6a6d2048751043f58596787d9859c0f5"
format_stamp: "Formatted at 2026-08-10 14:31:25 on dist-test-slave-0b58"
server_key: "11c1a5aea8b4997bedaf8e0bb50783a9"
server_key_iv: "8bbd9204f4a206ffb886adc600efb13a"
server_key_version: "encryptionkey@0"
I20260810 14:31:25.738241 12808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "6a6d2048751043f58596787d9859c0f5"
format_stamp: "Formatted at 2026-08-10 14:31:25 on dist-test-slave-0b58"
server_key: "11c1a5aea8b4997bedaf8e0bb50783a9"
server_key_iv: "8bbd9204f4a206ffb886adc600efb13a"
server_key_version: "encryptionkey@0"
I20260810 14:31:25.742136 12808 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:31:25.744668 12823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:25.745931 12808 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:31:25.746080 12808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "6a6d2048751043f58596787d9859c0f5"
format_stamp: "Formatted at 2026-08-10 14:31:25 on dist-test-slave-0b58"
server_key: "11c1a5aea8b4997bedaf8e0bb50783a9"
server_key_iv: "8bbd9204f4a206ffb886adc600efb13a"
server_key_version: "encryptionkey@0"
I20260810 14:31:25.746219 12808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:25.759034 12808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:25.762117 12808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:25.762343 12808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:25.770092 12808 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39427
I20260810 14:31:25.770397 12880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39427 every 8 connection(s)
I20260810 14:31:25.771119 12808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:31:25.774308 12881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:25.779872 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 12808
I20260810 14:31:25.780019 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:31:25.780241 12881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5: Bootstrap starting.
I20260810 14:31:25.780364 1849 external_mini_cluster.cc:1428] Setting key 3beb8f84829eb351c785a4219f2da983
I20260810 14:31:25.783032 12881 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:25.783849 12881 log.cc:824] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:25.786018 12881 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5: No bootstrap required, opened a new log
Aug 10 14:31:25 dist-test-slave-0b58 krb5kdc[12793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:31:25.790763 12881 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6d2048751043f58596787d9859c0f5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39427 } }
I20260810 14:31:25.791114 12881 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:25.791220 12881 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a6d2048751043f58596787d9859c0f5, State: Initialized, Role: FOLLOWER
I20260810 14:31:25.791712 12881 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6d2048751043f58596787d9859c0f5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39427 } }
I20260810 14:31:25.791846 12881 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:31:25.791932 12881 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:31:25.792038 12881 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:25.793043 12881 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6d2048751043f58596787d9859c0f5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39427 } }
I20260810 14:31:25.793469 12881 leader_election.cc:302] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a6d2048751043f58596787d9859c0f5; no voters:
I20260810 14:31:25.793851 12881 leader_election.cc:288] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:31:25.793937 12888 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:25.794166 12888 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: 6a6d2048751043f58596787d9859c0f5, State: Running, Role: LEADER
I20260810 14:31:25.794487 12888 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6d2048751043f58596787d9859c0f5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39427 } }
I20260810 14:31:25.795285 12881 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:31:25.796370 12890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a6d2048751043f58596787d9859c0f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6d2048751043f58596787d9859c0f5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39427 } } }
I20260810 14:31:25.796490 12890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:25.796893 12898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:31:25.796917 12889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a6d2048751043f58596787d9859c0f5. Latest consensus state: current_term: 1 leader_uuid: "6a6d2048751043f58596787d9859c0f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6d2048751043f58596787d9859c0f5" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39427 } } }
I20260810 14:31:25.797076 12889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5 [sys.catalog]: This master's current role is: LEADER
I20260810 14:31:25.797096 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:25.781998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50984 (local address 127.1.206.126:39427)
0810 14:31:25.782449 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:25.782465 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:25.782501 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:31:25.783231 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:25.783253 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:25.783595 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:25.783877 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:25.784810 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:25.785837 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:25.786999 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:25.787470 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:25.787591 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:25.790511 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:25.790516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:25.790530 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:25.790558 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:25.792686 (+ 2128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:25.793157 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:25.793164 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:25.793170 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:25.793330 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:25.793628 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:25.793632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:25.793634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:25.794257 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:25.795168 (+ 911us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:25.795324 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 14:31:25.795661 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":155,"threads_started":1}
I20260810 14:31:25.800304 12898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:31:25.806723 12898 catalog_manager.cc:1347] Generated new cluster ID: cc29fcbfcdf54717b29e17468d9d9230
I20260810 14:31:25.806824 12898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:31:25.817063 12898 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:31:25.818104 12898 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:31:25.827473 12898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5: Generated new TSK 0
I20260810 14:31:25.828248 12898 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:31:25.859174 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39427
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:25.988453 12911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:25.988763 12911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:25.988811 12911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:25.992931 12911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:25.993002 12911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:25.993064 12911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:31:25.998809 12911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:25.999910 12911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:26.000999 12911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:31:26.011276 12911 server_base.cc:1034] running on GCE node
W20260810 14:31:26.011132 12916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:26.011152 12917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:26.011134 12919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:26.011857 12911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:26.012622 12911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:26.013845 12911 hybrid_clock.cc:648] HybridClock initialized: now 1786372286013813 us; error 29 us; skew 500 ppm
Aug 10 14:31:26 dist-test-slave-0b58 krb5kdc[12793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372286, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:26.017078 12911 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:31:26.018021 12911 webserver.cc:460] Webserver started at http://127.1.206.65:39253/ using document root <none> and password file <none>
I20260810 14:31:26.018649 12911 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:26.018715 12911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:26.018985 12911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:26.021178 12911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "c2510333fe9542c995c4302a4d256f7d"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "88ff96e2fe5e26168fd2e03f439a2bec"
server_key_iv: "30551625b869ceca1e91c1cc537fd8b3"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.021776 12911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "c2510333fe9542c995c4302a4d256f7d"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "88ff96e2fe5e26168fd2e03f439a2bec"
server_key_iv: "30551625b869ceca1e91c1cc537fd8b3"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.025735 12911 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:31:26.028857 12926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.030242 12911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:31:26.030388 12911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "c2510333fe9542c995c4302a4d256f7d"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "88ff96e2fe5e26168fd2e03f439a2bec"
server_key_iv: "30551625b869ceca1e91c1cc537fd8b3"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.030525 12911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:26.048609 12911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:26.052410 12911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:26.052639 12911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:26.053318 12911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:26.054216 12911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:26.054293 12911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.054369 12911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:26.054411 12911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.063611 12911 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:44701
I20260810 14:31:26.063634 13044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:44701 every 8 connection(s)
I20260810 14:31:26.064601 12911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:31:26.067308 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 12911
I20260810 14:31:26.067454 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:31:26.067767 1849 external_mini_cluster.cc:1428] Setting key a2d5bcc8d4740c3ca5f8ca1569b001c6
Aug 10 14:31:26 dist-test-slave-0b58 krb5kdc[12793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372286, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:31:26.079923 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.066509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:42297 (local address 127.1.206.126:39427)
0810 14:31:26.066689 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.066695 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.067715 (+ 1020us) server_negotiation.cc:407] Connection header received
0810 14:31:26.069333 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.069336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.069390 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.069467 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:26.070658 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.071195 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.072419 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.072816 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.072936 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.075655 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:26.075662 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:26.075667 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:26.075707 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:26.077635 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.078216 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.078220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.078225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.078341 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.078683 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.078690 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.078692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.078971 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:26.079077 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.079651 (+ 574us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.079787 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:31:26.080961 13047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.066936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39427 (local address 127.1.206.65:42297)
0810 14:31:26.067538 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.067593 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.069105 (+ 1512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.069637 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.069644 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.070011 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:26.070496 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.070510 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.071346 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.071356 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.072279 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.072289 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.072999 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.073002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.073160 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.073810 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:26.073828 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:26.075439 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:26.077786 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:26.077791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:26.077819 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:26.078097 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:26.078439 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:26.078441 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:26.078442 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:26.078580 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:26.079088 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:26.079093 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:26.079355 (+ 262us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.079524 (+ 169us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.079920 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":227,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:31:26.082412 13045 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39427
I20260810 14:31:26.082685 13045 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:26.083206 13045 heartbeater.cc:511] Master 127.1.206.126:39427 requested a full tablet report, sending...
I20260810 14:31:26.084918 12841 ts_manager.cc:194] Registered new tserver with Master: c2510333fe9542c995c4302a4d256f7d (127.1.206.65:44701)
I20260810 14:31:26.086130 12841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:42297
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:31:26.098963 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39427
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:26.213320 13051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:26.213622 13051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:26.213706 13051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:26.217840 13051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:26.217931 13051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:26.218017 13051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:31:26.224447 13051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:26.226107 13051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:26.228101 13051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:26.238119 13056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:26.238183 13057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:26.238130 13059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:26.238271 13051 server_base.cc:1034] running on GCE node
I20260810 14:31:26.238842 13051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:26.239445 13051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:26.240602 13051 hybrid_clock.cc:648] HybridClock initialized: now 1786372286240588 us; error 26 us; skew 500 ppm
Aug 10 14:31:26 dist-test-slave-0b58 krb5kdc[12793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372286, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:26.248436 13051 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:31:26.249387 13051 webserver.cc:460] Webserver started at http://127.1.206.66:42731/ using document root <none> and password file <none>
I20260810 14:31:26.250056 13051 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:26.250150 13051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:26.250435 13051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:26.252758 13051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "eaa98a9f43b14f05aa664d4dbc4e1500"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "5a4423eb9549bbaa3cab40d0f33d8a32"
server_key_iv: "f93211dbe46ebb242d792cfdeff3231f"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.253366 13051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "eaa98a9f43b14f05aa664d4dbc4e1500"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "5a4423eb9549bbaa3cab40d0f33d8a32"
server_key_iv: "f93211dbe46ebb242d792cfdeff3231f"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.257373 13051 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:31:26.259835 13068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.261173 13051 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:26.261346 13051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "eaa98a9f43b14f05aa664d4dbc4e1500"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "5a4423eb9549bbaa3cab40d0f33d8a32"
server_key_iv: "f93211dbe46ebb242d792cfdeff3231f"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.261474 13051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:26.281374 13051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:26.285354 13051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:26.285616 13051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:26.286422 13051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:26.287341 13051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:26.287417 13051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.287487 13051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:26.287530 13051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.297411 13051 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:44819
I20260810 14:31:26.297449 13187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:44819 every 8 connection(s)
I20260810 14:31:26.298403 13051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:31:26.306529 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 13051
I20260810 14:31:26.306682 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:31:26.306975 1849 external_mini_cluster.cc:1428] Setting key 706e09c1bf63918016816afad917a018
Aug 10 14:31:26 dist-test-slave-0b58 krb5kdc[12793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372286, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:31:26.314023 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.300385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:34999 (local address 127.1.206.126:39427)
0810 14:31:26.300532 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.300536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.301545 (+ 1009us) server_negotiation.cc:407] Connection header received
0810 14:31:26.302984 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.302988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.303049 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.303124 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:26.304383 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.304956 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.306179 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.306423 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.306541 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.309589 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:26.309595 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:26.309601 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:26.309637 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:26.311448 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.312191 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.312193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.312195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.312331 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.312766 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.312768 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.312769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.312958 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:26.313033 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.313780 (+ 747us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.313894 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:31:26.315447 13191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.300869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39427 (local address 127.1.206.66:34999)
0810 14:31:26.301383 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.301429 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.302750 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.303307 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.303314 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.303687 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:26.304185 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.304199 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.305099 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.305103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.306016 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.306027 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.306587 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.306591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.306843 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.307537 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:26.307560 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:26.309393 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:26.311586 (+ 2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:26.311597 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:26.311618 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:26.312069 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:26.312431 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:26.312438 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:26.312443 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:26.312659 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:26.313071 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:26.313082 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:26.313480 (+ 398us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.313718 (+ 238us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.314170 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":109,"threads_started":1}
I20260810 14:31:26.316988 13189 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39427
I20260810 14:31:26.317266 13189 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:26.317791 13189 heartbeater.cc:511] Master 127.1.206.126:39427 requested a full tablet report, sending...
I20260810 14:31:26.318945 12841 ts_manager.cc:194] Registered new tserver with Master: eaa98a9f43b14f05aa664d4dbc4e1500 (127.1.206.66:44819)
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:31:26.319618 12841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:34999
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:31:26.337594 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39427
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:31:26.451902 13196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:31:26.452185 13196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:31:26.452230 13196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:31:26.456238 13196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:31:26.456324 13196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:31:26.456382 13196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:31:26.461697 13196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:31:26.462752 13196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:31:26.463716 13196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:31:26.473500 13204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:26.473774 13196 server_base.cc:1034] running on GCE node
W20260810 14:31:26.473519 13202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:31:26.473508 13201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:31:26.474350 13196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:31:26.474957 13196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:31:26.476156 13196 hybrid_clock.cc:648] HybridClock initialized: now 1786372286476142 us; error 30 us; skew 500 ppm
Aug 10 14:31:26 dist-test-slave-0b58 krb5kdc[12793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372286, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:31:26.479185 13196 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:31:26.480173 13196 webserver.cc:460] Webserver started at http://127.1.206.67:33667/ using document root <none> and password file <none>
I20260810 14:31:26.480829 13196 fs_manager.cc:359] Metadata directory not provided
I20260810 14:31:26.480932 13196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:31:26.481194 13196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:31:26.483376 13196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "ff7e96919849c558b45a1b6298d9ff08"
server_key_iv: "6f68bcdd2907cde685966cb53fb7ca6d"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.483973 13196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "ff7e96919849c558b45a1b6298d9ff08"
server_key_iv: "6f68bcdd2907cde685966cb53fb7ca6d"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.487897 13196 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:31:26.490422 13213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.491611 13196 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:31:26.491760 13196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a"
format_stamp: "Formatted at 2026-08-10 14:31:26 on dist-test-slave-0b58"
server_key: "ff7e96919849c558b45a1b6298d9ff08"
server_key_iv: "6f68bcdd2907cde685966cb53fb7ca6d"
server_key_version: "encryptionkey@0"
I20260810 14:31:26.491880 13196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:31:26.511646 13196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:31:26.515031 13196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:31:26.515257 13196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:31:26.515868 13196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:31:26.516716 13196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:31:26.516788 13196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.516858 13196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:31:26.516917 13196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:31:26.526041 13196 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:36985
I20260810 14:31:26.526149 13334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:36985 every 8 connection(s)
I20260810 14:31:26.527025 13196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:31:26.535084 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 13196
I20260810 14:31:26.535187 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:31:26.535583 1849 external_mini_cluster.cc:1428] Setting key d554bcbbb263ef729e703148b2f3d522
Aug 10 14:31:26 dist-test-slave-0b58 krb5kdc[12793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372286, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:31:26.540954 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.528986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:60987 (local address 127.1.206.126:39427)
0810 14:31:26.529132 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.529135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.529946 (+ 811us) server_negotiation.cc:407] Connection header received
0810 14:31:26.531345 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.531348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.531409 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.531515 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:26.532779 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.533323 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.534532 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.534778 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.534893 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.537789 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:26.537796 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:26.537801 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:26.537833 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:26.539116 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.539579 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.539581 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.539582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.539657 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.539968 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.539970 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.539971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.540145 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:26.540222 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.540724 (+ 502us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.540834 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:31:26.541800 13337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.529355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39427 (local address 127.1.206.67:60987)
0810 14:31:26.529793 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.529837 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.531113 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.531686 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.531693 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.532049 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:31:26.532623 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.532638 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.533455 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.533466 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.534407 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.534417 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.534936 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.534940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.535115 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.535828 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:31:26.535845 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:31:26.537593 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:31:26.539218 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:26.539222 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:26.539234 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:26.539490 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:26.539736 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:31:26.539738 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:31:26.539739 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:31:26.539888 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:31:26.540232 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:31:26.540237 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:31:26.540515 (+ 278us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.540674 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.540946 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":105,"threads_started":1}
I20260810 14:31:26.542958 13335 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39427
I20260810 14:31:26.543208 13335 heartbeater.cc:464] Registering TS with master...
I20260810 14:31:26.543706 13335 heartbeater.cc:511] Master 127.1.206.126:39427 requested a full tablet report, sending...
I20260810 14:31:26.544795 12841 ts_manager.cc:194] Registered new tserver with Master: e93e3e6e984e47d4ac9f60fc440d6f6a (127.1.206.67:36985)
I20260810 14:31:26.545378 12841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:60987
I20260810 14:31:26.549774 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:31:26.559949 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.551730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50994 (local address 127.1.206.126:39427)
0810 14:31:26.551848 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.551851 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.552082 (+ 231us) server_negotiation.cc:407] Connection header received
0810 14:31:26.552184 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.552187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.552223 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.552382 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:31:26.553028 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.553534 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.554345 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.554550 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.554623 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.556126 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:31:26.556130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:31:26.556132 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:31:26.556183 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:31:26.558179 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.558632 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.558636 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.558638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.558730 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:31:26.559012 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:31:26.559016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:31:26.559018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:31:26.559257 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:31:26.559398 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.559653 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.559781 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 14:31:26.563979 12841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:31:26.567777 12841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:31:26.582506 13350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.576506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:44819 (local address 127.0.0.1:47104)
0810 14:31:26.577351 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.577409 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.577559 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.578221 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.578227 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.578253 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:26.578416 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.578422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.579629 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.579634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.580882 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.580894 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.581927 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.581930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.582045 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.582087 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.582205 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.582344 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":85,"threads_started":1}
I20260810 14:31:26.582520 13352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.576619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47104 (local address 127.1.206.66:44819)
0810 14:31:26.577133 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.577153 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.577719 (+ 566us) server_negotiation.cc:407] Connection header received
0810 14:31:26.577807 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.577815 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.578047 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.578242 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:26.578553 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.579494 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.581033 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.581794 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.581907 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.582064 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.582252 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.582357 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":145,"threads_started":1}
I20260810 14:31:26.583457 13355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.577328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51226 (local address 127.1.206.65:44701)
0810 14:31:26.578336 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.578353 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.578376 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:31:26.578447 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.578453 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.578619 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.578770 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:26.578984 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.580095 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.581701 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.582551 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.582669 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.582817 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.583231 (+ 414us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.583331 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":883,"thread_start_us":113,"threads_started":1}
I20260810 14:31:26.583593 13354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.577325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.1.206.67:36985)
0810 14:31:26.577791 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.577803 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.577995 (+ 192us) server_negotiation.cc:407] Connection header received
0810 14:31:26.578084 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.578089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.578270 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.578417 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:26.578872 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.580048 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.581756 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.582583 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.582692 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.582846 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.583367 (+ 521us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.583461 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":113,"threads_started":1}
I20260810 14:31:26.583436 13353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.576831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:44701 (local address 127.0.0.1:51226)
0810 14:31:26.578005 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.578019 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.578091 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.578762 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.578765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.578785 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:26.578884 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.578890 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.580228 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.580230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.581557 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.581568 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.582882 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.582886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.583024 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.583082 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.583194 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.583279 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1119,"mutex_wait_us":52,"thread_start_us":88,"threads_started":1}
I20260810 14:31:26.584235 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.576551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:36985 (local address 127.0.0.1:38952)
0810 14:31:26.577784 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.577800 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.577892 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.578587 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.578590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.578607 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:26.578730 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.578737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.580220 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.580223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.581613 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.581623 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.582908 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.582912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.583085 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.583113 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.583187 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.583264 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"mutex_wait_us":272,"thread_start_us":113,"threads_started":1}
I20260810 14:31:26.586423 12975 tablet_service.cc:1467] Processing CreateTablet for tablet 3070c792f8f34a6ab4916f74cd1d3683 (DEFAULT_TABLE table=test-table [id=2f580954e5064fbeae81b6dee9609a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:26.586340 13119 tablet_service.cc:1467] Processing CreateTablet for tablet 3070c792f8f34a6ab4916f74cd1d3683 (DEFAULT_TABLE table=test-table [id=2f580954e5064fbeae81b6dee9609a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:26.586781 13262 tablet_service.cc:1467] Processing CreateTablet for tablet 3070c792f8f34a6ab4916f74cd1d3683 (DEFAULT_TABLE table=test-table [id=2f580954e5064fbeae81b6dee9609a72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:31:26.587443 12975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3070c792f8f34a6ab4916f74cd1d3683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:26.587461 13119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3070c792f8f34a6ab4916f74cd1d3683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:26.587667 13262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3070c792f8f34a6ab4916f74cd1d3683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:31:26.593639 13356 tablet_bootstrap.cc:492] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d: Bootstrap starting.
I20260810 14:31:26.595402 13358 tablet_bootstrap.cc:492] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Bootstrap starting.
I20260810 14:31:26.596024 13356 tablet_bootstrap.cc:654] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:26.596542 13357 tablet_bootstrap.cc:492] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Bootstrap starting.
I20260810 14:31:26.596928 13356 log.cc:824] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:26.599263 13357 tablet_bootstrap.cc:654] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:26.599555 13356 tablet_bootstrap.cc:492] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d: No bootstrap required, opened a new log
I20260810 14:31:26.599743 13356 ts_tablet_manager.cc:1397] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260810 14:31:26.600188 13357 log.cc:824] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:26.601094 13358 tablet_bootstrap.cc:654] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Neither blocks nor log segments found. Creating new log.
I20260810 14:31:26.602243 13358 log.cc:824] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:31:26.602396 13357 tablet_bootstrap.cc:492] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: No bootstrap required, opened a new log
I20260810 14:31:26.602576 13357 ts_tablet_manager.cc:1397] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:31:26.604359 13358 tablet_bootstrap.cc:492] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: No bootstrap required, opened a new log
I20260810 14:31:26.604559 13358 ts_tablet_manager.cc:1397] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260810 14:31:26.604323 13356 raft_consensus.cc:348] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.604643 13356 raft_consensus.cc:374] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:26.604707 13356 raft_consensus.cc:729] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2510333fe9542c995c4302a4d256f7d, State: Initialized, Role: FOLLOWER
I20260810 14:31:26.605232 13356 consensus_queue.cc:260] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.606288 13356 ts_tablet_manager.cc:1428] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 14:31:26.606664 13045 heartbeater.cc:503] Master 127.1.206.126:39427 was elected leader, sending a full tablet report...
I20260810 14:31:26.606439 13357 raft_consensus.cc:348] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.607702 13357 raft_consensus.cc:374] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:26.607983 13357 raft_consensus.cc:729] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa98a9f43b14f05aa664d4dbc4e1500, State: Initialized, Role: FOLLOWER
I20260810 14:31:26.607947 13358 raft_consensus.cc:348] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.608227 13358 raft_consensus.cc:374] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:31:26.608319 13358 raft_consensus.cc:729] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e93e3e6e984e47d4ac9f60fc440d6f6a, State: Initialized, Role: FOLLOWER
I20260810 14:31:26.608489 13357 consensus_queue.cc:260] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.608762 13358 consensus_queue.cc:260] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.609246 13189 heartbeater.cc:503] Master 127.1.206.126:39427 was elected leader, sending a full tablet report...
I20260810 14:31:26.609525 13357 ts_tablet_manager.cc:1428] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 14:31:26.609707 13358 ts_tablet_manager.cc:1428] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 14:31:26.610021 13335 heartbeater.cc:503] Master 127.1.206.126:39427 was elected leader, sending a full tablet report...
W20260810 14:31:26.778007 13336 tablet.cc:2369] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:31:26.799813 13190 tablet.cc:2369] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:31:26.806736 13365 raft_consensus.cc:482] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:31:26.807027 13365 raft_consensus.cc:504] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.808284 13365 leader_election.cc:288] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e93e3e6e984e47d4ac9f60fc440d6f6a (127.1.206.67:36985), c2510333fe9542c995c4302a4d256f7d (127.1.206.65:44701)
I20260810 14:31:26.812561 13354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.808629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:48485 (local address 127.1.206.67:36985)
0810 14:31:26.808769 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.808774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.808794 (+ 20us) server_negotiation.cc:407] Connection header received
0810 14:31:26.808964 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.808966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.809054 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.809138 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:26.809468 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.810186 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.811352 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.811991 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.812084 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.812127 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.812393 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.812454 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 14:31:26.812600 13191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.808510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:36985 (local address 127.1.206.66:48485)
0810 14:31:26.808680 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.808698 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.808823 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.809164 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.809170 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.809187 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:26.809327 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.809336 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.810316 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.810319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.811206 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.811216 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.812109 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.812112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.812223 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.812274 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.812379 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.812460 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260810 14:31:26.813248 13367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.808553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:44701 (local address 127.1.206.66:44117)
0810 14:31:26.808956 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.808967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:31:26.809079 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:31:26.809480 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:31:26.809483 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:31:26.809499 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:31:26.809598 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.809604 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.810751 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.810754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.811813 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:31:26.811825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.812882 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.812887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:31:26.812977 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.813001 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 14:31:26.813080 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 14:31:26.813145 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":107,"threads_started":1}
I20260810 14:31:26.813354 13355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.808743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:44117 (local address 127.1.206.65:44701)
0810 14:31:26.808894 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.808901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.809046 (+ 145us) server_negotiation.cc:407] Connection header received
0810 14:31:26.809201 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.809205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.809278 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.809333 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:31:26.809723 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.810445 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.811960 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.812608 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.812731 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.812787 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.813123 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.813237 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 14:31:26.813433 13283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3070c792f8f34a6ab4916f74cd1d3683" candidate_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" is_pre_election: true
I20260810 14:31:26.813791 13283 raft_consensus.cc:2454] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa98a9f43b14f05aa664d4dbc4e1500 in term 0.
I20260810 14:31:26.813970 12997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3070c792f8f34a6ab4916f74cd1d3683" candidate_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2510333fe9542c995c4302a4d256f7d" is_pre_election: true
I20260810 14:31:26.814265 12997 raft_consensus.cc:2454] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eaa98a9f43b14f05aa664d4dbc4e1500 in term 0.
I20260810 14:31:26.814368 13070 leader_election.cc:302] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e93e3e6e984e47d4ac9f60fc440d6f6a, eaa98a9f43b14f05aa664d4dbc4e1500; no voters:
I20260810 14:31:26.814671 13365 raft_consensus.cc:2781] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:31:26.814769 13365 raft_consensus.cc:482] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:31:26.814823 13365 raft_consensus.cc:3037] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 0 FOLLOWER]: Advancing to term 1
W20260810 14:31:26.816005 13046 tablet.cc:2369] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:31:26.815966 13365 raft_consensus.cc:504] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.816382 13365 leader_election.cc:288] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [CANDIDATE]: Term 1 election: Requested vote from peers e93e3e6e984e47d4ac9f60fc440d6f6a (127.1.206.67:36985), c2510333fe9542c995c4302a4d256f7d (127.1.206.65:44701)
I20260810 14:31:26.816762 12997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3070c792f8f34a6ab4916f74cd1d3683" candidate_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2510333fe9542c995c4302a4d256f7d"
I20260810 14:31:26.816763 13283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3070c792f8f34a6ab4916f74cd1d3683" candidate_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a"
I20260810 14:31:26.816896 12997 raft_consensus.cc:3037] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:26.816896 13283 raft_consensus.cc:3037] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:31:26.818207 12997 raft_consensus.cc:2454] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa98a9f43b14f05aa664d4dbc4e1500 in term 1.
I20260810 14:31:26.818207 13283 raft_consensus.cc:2454] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eaa98a9f43b14f05aa664d4dbc4e1500 in term 1.
I20260810 14:31:26.818542 13071 leader_election.cc:302] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2510333fe9542c995c4302a4d256f7d, eaa98a9f43b14f05aa664d4dbc4e1500; no voters:
I20260810 14:31:26.818784 13365 raft_consensus.cc:2781] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:31:26.819023 13365 raft_consensus.cc:686] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 1 LEADER]: Becoming Leader. State: Replica: eaa98a9f43b14f05aa664d4dbc4e1500, State: Running, Role: LEADER
I20260810 14:31:26.819382 13365 consensus_queue.cc:237] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } }
I20260810 14:31:26.822697 12841 catalog_manager.cc:5495] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 reported cstate change: term changed from 0 to 1, leader changed from <none> to eaa98a9f43b14f05aa664d4dbc4e1500 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eaa98a9f43b14f05aa664d4dbc4e1500" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 } health_report { overall_health: UNKNOWN } } }
I20260810 14:31:26.875856 13352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.872031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47114 (local address 127.1.206.66:44819)
0810 14:31:26.872193 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 14:31:26.872198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:31:26.872214 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:31:26.872363 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:31:26.872366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:31:26.872427 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:31:26.872526 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:31:26.872801 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.873311 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.874279 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:31:26.874491 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:31:26.874574 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:31:26.874865 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:31:26.875377 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:31:26.875469 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 14:31:26.875620 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 14:31:26.875686 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 14:31:26.881809 13283 raft_consensus.cc:1261] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 1 FOLLOWER]: Refusing update from remote peer eaa98a9f43b14f05aa664d4dbc4e1500: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:26.881810 12997 raft_consensus.cc:1261] T 3070c792f8f34a6ab4916f74cd1d3683 P c2510333fe9542c995c4302a4d256f7d [term 1 FOLLOWER]: Refusing update from remote peer eaa98a9f43b14f05aa664d4dbc4e1500: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:31:26.882651 13368 consensus_queue.cc:1035] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2510333fe9542c995c4302a4d256f7d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 44701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:26.882845 13365 consensus_queue.cc:1035] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e93e3e6e984e47d4ac9f60fc440d6f6a" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 36985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:31:26.891237 13371 mvcc.cc:205] Tried to move back new op lower bound from 7316980887060197376 to 7316980886815174656. Current Snapshot: MvccSnapshot[applied={T|T < 7316980887060197376}]
I20260810 14:31:26.901345 12841 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:26.901511 12841 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:31:26.904018 12841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a6d2048751043f58596787d9859c0f5: Sending DeleteTablet for 3 replicas of tablet 3070c792f8f34a6ab4916f74cd1d3683
I20260810 14:31:26.904874 13119 tablet_service.cc:1514] Processing DeleteTablet for tablet 3070c792f8f34a6ab4916f74cd1d3683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:26 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:47104
I20260810 14:31:26.905151 12975 tablet_service.cc:1514] Processing DeleteTablet for tablet 3070c792f8f34a6ab4916f74cd1d3683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:26 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:51226
I20260810 14:31:26.905382 13262 tablet_service.cc:1514] Processing DeleteTablet for tablet 3070c792f8f34a6ab4916f74cd1d3683 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:31:26 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:38952
I20260810 14:31:26.905879 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 12911
I20260810 14:31:26.910760 13385 tablet_replica.cc:330] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: stopping tablet replica
I20260810 14:31:26.911063 13382 tablet_replica.cc:330] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: stopping tablet replica
I20260810 14:31:26.911212 13385 raft_consensus.cc:2229] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:31:26.911440 13382 raft_consensus.cc:2229] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:31:26.911648 13385 raft_consensus.cc:2258] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:26.911924 13382 raft_consensus.cc:2258] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:31:26.913604 13385 ts_tablet_manager.cc:1905] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:26.914044 13382 ts_tablet_manager.cc:1905] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:31:26.916354 13385 ts_tablet_manager.cc:1918] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:26.916457 13385 log.cc:1196] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/3070c792f8f34a6ab4916f74cd1d3683
I20260810 14:31:26.916787 13385 ts_tablet_manager.cc:1939] T 3070c792f8f34a6ab4916f74cd1d3683 P e93e3e6e984e47d4ac9f60fc440d6f6a: Deleting consensus metadata
I20260810 14:31:26.917336 13382 ts_tablet_manager.cc:1918] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:31:26.917513 13382 log.cc:1196] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/3070c792f8f34a6ab4916f74cd1d3683
I20260810 14:31:26.917915 13382 ts_tablet_manager.cc:1939] T 3070c792f8f34a6ab4916f74cd1d3683 P eaa98a9f43b14f05aa664d4dbc4e1500: Deleting consensus metadata
I20260810 14:31:26.918082 12825 catalog_manager.cc:4841] TS e93e3e6e984e47d4ac9f60fc440d6f6a (127.1.206.67:36985): tablet 3070c792f8f34a6ab4916f74cd1d3683 (table test-table [id=2f580954e5064fbeae81b6dee9609a72]) successfully deleted
I20260810 14:31:26.919129 12824 catalog_manager.cc:4841] TS eaa98a9f43b14f05aa664d4dbc4e1500 (127.1.206.66:44819): tablet 3070c792f8f34a6ab4916f74cd1d3683 (table test-table [id=2f580954e5064fbeae81b6dee9609a72]) successfully deleted
W20260810 14:31:26.919907 12826 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:44701 (error 108)
I20260810 14:31:26.920173 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 13051
I20260810 14:31:26.922360 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:31:26.922023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:44701 (local address 127.0.0.1:51238)
0810 14:31:26.922208 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 14:31:26.922283 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:44701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260810 14:31:26.922534 12826 catalog_manager.cc:4584] TS c2510333fe9542c995c4302a4d256f7d (127.1.206.65:44701): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3070c792f8f34a6ab4916f74cd1d3683: Network error: Client connection negotiation failed: client connection to 127.1.206.65:44701: connect: Connection refused (error 111)
I20260810 14:31:26.930236 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 13196
I20260810 14:31:26.941360 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 12808
2026-08-10T14:31:26Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2589 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:31:27 dist-test-slave-0b58 krb5kdc[13390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:31:27 dist-test-slave-0b58 krb5kdc[13390](info): set up 2 sockets
Aug 10 14:31:27 dist-test-slave-0b58 krb5kdc[13390](info): commencing operation
krb5kdc: starting...
W20260810 14:31:28.043642 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:31:28 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:31:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:31:28Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/rangeradmin_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/rangeradmin_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/rangerlookup_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/rangerlookup_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
I20260810 14:31:28.221246 1849 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskN56qvq/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/postgres -l logfile start
2026-08-10 14:31:30.745 UTC [13424] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 14:31:30.745 UTC [13424] LOG: listening on IPv4 address "127.1.206.84", port 50305
2026-08-10 14:31:30.749 UTC [13424] LOG: listening on Unix socket "/tmp/.s.PGSQL.50305"
2026-08-10 14:31:30.771 UTC [13427] LOG: database system was shut down at 2026-08-10 14:31:29 UTC
2026-08-10 14:31:30.775 UTC [13424] LOG: database system is ready to accept connections
I20260810 14:31:31.763921 1849 mini_postgres.cc:96] Postgres bound to 50305
2026-08-10 14:31:31.772 UTC [13437] FATAL: database "slave" does not exist
127.1.206.84:50305 - accepting connections
I20260810 14:31:31.773454 1849 mini_ranger.cc:161] Starting Ranger...
I20260810 14:31:31.791795 1849 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 14:31:32.277230 1849 mini_ranger.cc:87] Created ranger Postgres database
I20260810 14:31:32.277323 1849 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-admin
2026-08-10 14:31:32,616 [I] DB FLAVOR :POSTGRES
2026-08-10 14:31:32,617 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:31:32,617 [I] Checking connection..
2026-08-10 14:31:32,617 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 14:31:32,899 [I] Checking connection passed.
2026-08-10 14:31:32,899 [I] --------- Verifying version history table ---------
2026-08-10 14:31:32,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:31:33,141 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:31:33,141 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:31:33,392 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:31:33,392 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 14:31:33,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 14:31:33.659 UTC [13508] WARNING: there is no transaction in progress
2026-08-10 14:31:33,666 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 14:31:33,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:31:33,921 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 14:31:33,921 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:31:33,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 14:31:34,169 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 14:31:34,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-10 14:31:34,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:31:34,892 [I] Table x_portal_user does not exist in database ranger
2026-08-10 14:31:34,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:31:35,158 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 14:31:35,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:31:35,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:31:35,676 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 14:31:35,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 14:31:36.648 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.666 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.683 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.699 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.715 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.737 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.793 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.800 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.817 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.828 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.838 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.852 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.862 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.869 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.876 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:36.882 UTC [13629] WARNING: there is no transaction in progress
2026-08-10 14:31:37,588 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 14:31:37,589 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 14:31:37,851 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 14:31:37,851 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:31:38,129 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 14:31:38,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:31:38,404 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 14:31:38,405 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:31:38,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:31:38,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-10 14:31:39,148 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 14:31:39,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 14:31:39,407 [I] DB_PATCHES have already been applied
I20260810 14:31:39.413573 1849 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-admin:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskN56qvq/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 14:31:39.413690 1849 mini_ranger.cc:193] Using host: 127.1.206.84
I20260810 14:31:39.418560 1849 mini_ranger.cc:227] Ranger admin URL: http://127.1.206.84:46585
Aug 10, 2026 2:31:39 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:31:39 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:31:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 2:31:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 2:31:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 2:31:40 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 2:31:40 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 14:31:40.599975 1849 mini_ranger.cc:160] Time spent starting Ranger: real 8.827s user 0.000s sys 0.014s
Aug 10, 2026 2:32:01 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 2:32:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 2:32:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 2:32:01 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 2:32:02 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 14:32:02.889721 1849 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/rangerkms_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/rangerkms_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.206.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.206.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 14:32:03 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372323, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 14:32:03.021214 1849 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 14:32:03.033619 1849 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 14:32:04.081475 1849 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 14:32:04.081588 1849 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms
I20260810 14:32:04.081699 1849 mini_ranger_kms.cc:227] Using postgres at 127.1.206.84:50305
2026-08-10 14:32:04,334 [I] DB FLAVOR :POSTGRES
2026-08-10 14:32:04,335 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:32:04,335 [I] Checking connection
2026-08-10 14:32:04,335 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 14:32:04,632 [I] connection success
2026-08-10 14:32:04,632 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 14:32:04,632 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 14:32:04,632 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 14:32:04,899 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 14:32:04,900 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:32:04,900 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 14:32:04,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:50305/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 14:32:05,184 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 14:32:05.721719 1849 mini_ranger_kms.cc:310] Created kms service
I20260810 14:32:05.931527 1849 mini_ranger_kms.cc:326] Created kudu user
I20260810 14:32:05.978751 1849 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 14:32:05 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372323, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:06.410678 1849 mini_ranger_kms.cc:384] Added ranger policy
I20260810 14:32:06.410861 1849 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms:/tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 14:32:06.410890 1849 mini_ranger_kms.cc:240] Using host: 127.1.206.84
I20260810 14:32:06.415791 1849 mini_ranger_kms.cc:276] Ranger KMS PID: 13829
I20260810 14:32:06.415984 1849 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.206.84:34073
Aug 10, 2026 2:32:07 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:32:07 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:32:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 2:32:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 2:32:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 2:32:08 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260810 14:32:08.804795 1849 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.784s user 0.010s sys 0.224s
I20260810 14:32:08.804958 1849 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 14:32:08.805092 1849 mini_ranger_kms.cc:401] 127.1.206.84:34073/kms/v1/keys
Aug 10 14:32:08 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786372328, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.206.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 14:32:09 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372328, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.206.84@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
Aug 10 14:32:09 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372328, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.206.84@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
Aug 10 14:32:11 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:32:12.031924 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:40995
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:40995
--ranger_config_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:34073/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:32:12.158849 13887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:32:12.159154 13887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:32:12.159197 13887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:32:12.163355 13887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:32:12.163439 13887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:32:12.163460 13887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:32:12.163475 13887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:32:12.163491 13887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:32:12.169353 13887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.206.84:34073/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:40995
--ranger_config_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:40995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:32:12.170564 13887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:32:12.171666 13887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:32:12.181011 13895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:12.181048 13893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:12.181013 13892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:32:12.181295 13887 server_base.cc:1034] running on GCE node
I20260810 14:32:12.181957 13887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:32:12.183090 13887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:32:12.184324 13887 hybrid_clock.cc:648] HybridClock initialized: now 1786372332184304 us; error 31 us; skew 500 ppm
Aug 10 14:32:12 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372332, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:32:12.187224 13887 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:32:12.188082 13887 webserver.cc:460] Webserver started at http://127.1.206.126:41691/ using document root <none> and password file <none>
I20260810 14:32:12.188660 13887 fs_manager.cc:359] Metadata directory not provided
I20260810 14:32:12.188719 13887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:32:12.188889 13887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:32:12 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372332, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:12.247726 13887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "84ecd3868e7348eb93ed6ffb135b6417"
format_stamp: "Formatted at 2026-08-10 14:32:12 on dist-test-slave-0b58"
server_key: "d2d7ac434f2c883add4c10531b201b31"
server_key_iv: "a23496952cbd61ba1d809b036cc4ef19"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:12.248425 13887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "84ecd3868e7348eb93ed6ffb135b6417"
format_stamp: "Formatted at 2026-08-10 14:32:12 on dist-test-slave-0b58"
server_key: "d2d7ac434f2c883add4c10531b201b31"
server_key_iv: "a23496952cbd61ba1d809b036cc4ef19"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:12.252576 13887 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:32:12.268040 13902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:12.269673 13887 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:32:12.269836 13887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "84ecd3868e7348eb93ed6ffb135b6417"
format_stamp: "Formatted at 2026-08-10 14:32:12 on dist-test-slave-0b58"
server_key: "d2d7ac434f2c883add4c10531b201b31"
server_key_iv: "a23496952cbd61ba1d809b036cc4ef19"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:12.269985 13887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:32:12.282460 13887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:32:12.285555 13887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:32:12.285802 13887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:32:12.293951 13887 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:40995
I20260810 14:32:12.293970 13958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:40995 every 8 connection(s)
I20260810 14:32:12.295178 13887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:32:12.298377 13959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:32:12.301681 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 13887
I20260810 14:32:12.301849 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:32:12.302137 1849 external_mini_cluster.cc:1428] Setting key f8fd86696506a210f7663a79310a311b
I20260810 14:32:12.305316 13959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417: Bootstrap starting.
I20260810 14:32:12.307811 13959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417: Neither blocks nor log segments found. Creating new log.
I20260810 14:32:12.308771 13959 log.cc:824] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417: Log is configured to *not* fsync() on all Append() calls
I20260810 14:32:12.311578 13959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417: No bootstrap required, opened a new log
Aug 10 14:32:12 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:32:12.316174 13959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ecd3868e7348eb93ed6ffb135b6417" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 40995 } }
I20260810 14:32:12.316540 13959 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:32:12.316650 13959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84ecd3868e7348eb93ed6ffb135b6417, State: Initialized, Role: FOLLOWER
I20260810 14:32:12.317246 13959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ecd3868e7348eb93ed6ffb135b6417" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 40995 } }
I20260810 14:32:12.317438 13959 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:32:12.317529 13959 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:32:12.317660 13959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:32:12.318758 13959 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ecd3868e7348eb93ed6ffb135b6417" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 40995 } }
I20260810 14:32:12.318959 13963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:12.303785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33822 (local address 127.1.206.126:40995)
0810 14:32:12.304424 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:12.304442 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:12.304486 (+ 44us) server_negotiation.cc:407] Connection header received
0810 14:32:12.305125 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:12.305143 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:12.305540 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:12.305903 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:32:12.306764 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:12.307809 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:12.308850 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:12.309543 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:12.309731 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:12.313233 (+ 3502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:32:12.313240 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:32:12.313255 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:32:12.313287 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:32:12.315328 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:12.315895 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:12.315901 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:12.315907 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:12.316032 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:12.316531 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:12.316536 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:12.316537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:12.317257 (+ 720us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:32:12.317495 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:12.317836 (+ 341us) server_negotiation.cc:299] Negotiation successful
0810 14:32:12.318139 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":190,"threads_started":1}
I20260810 14:32:12.319190 13959 leader_election.cc:302] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84ecd3868e7348eb93ed6ffb135b6417; no voters:
I20260810 14:32:12.319579 13959 leader_election.cc:288] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:32:12.319666 13965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:32:12.319895 13965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [term 1 LEADER]: Becoming Leader. State: Replica: 84ecd3868e7348eb93ed6ffb135b6417, State: Running, Role: LEADER
I20260810 14:32:12.320250 13965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ecd3868e7348eb93ed6ffb135b6417" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 40995 } }
I20260810 14:32:12.320958 13959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:32:12.322162 13966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84ecd3868e7348eb93ed6ffb135b6417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ecd3868e7348eb93ed6ffb135b6417" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 40995 } } }
I20260810 14:32:12.322144 13967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84ecd3868e7348eb93ed6ffb135b6417. Latest consensus state: current_term: 1 leader_uuid: "84ecd3868e7348eb93ed6ffb135b6417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ecd3868e7348eb93ed6ffb135b6417" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 40995 } } }
I20260810 14:32:12.322297 13966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [sys.catalog]: This master's current role is: LEADER
I20260810 14:32:12.322297 13967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417 [sys.catalog]: This master's current role is: LEADER
I20260810 14:32:12.322742 13976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:32:12.325541 13976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:32:12.326133 13959 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 14:32:12.335722 13976 catalog_manager.cc:1347] Generated new cluster ID: f10912381b024e97bb3648418135ea82
I20260810 14:32:12.335817 13976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:32:12.350214 13976 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:32:12.351518 13976 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:32:12.358739 13976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417: Generated new TSK 0
I20260810 14:32:12.359556 13976 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:32:13.061357 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:34073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:40995
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:32:13.216043 14014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:32:13.216401 14014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:32:13.216516 14014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:32:13.220906 14014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:32:13.220990 14014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:32:13.221095 14014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:32:13.228612 14014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.206.84:34073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:40995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:32:13.230391 14014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:32:13.231680 14014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:32:13.241683 14024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:13.241824 14027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:13.241701 14023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:32:13.242548 14014 server_base.cc:1034] running on GCE node
I20260810 14:32:13.243057 14014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:32:13.243963 14014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:32:13.245150 14014 hybrid_clock.cc:648] HybridClock initialized: now 1786372333245097 us; error 68 us; skew 500 ppm
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:32:13.248150 14014 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:32:13.249096 14014 webserver.cc:460] Webserver started at http://127.1.206.65:32909/ using document root <none> and password file <none>
I20260810 14:32:13.249696 14014 fs_manager.cc:359] Metadata directory not provided
I20260810 14:32:13.249794 14014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:32:13.250025 14014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:13.266872 14014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "7e2c2a6a24e34ebca096a4e39f65548e"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "f4dd248d4058f3f8bbdd5094bb0c9559"
server_key_iv: "f63be6824e661557fc6902f1b586dd82"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:13.268165 14014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "7e2c2a6a24e34ebca096a4e39f65548e"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "f4dd248d4058f3f8bbdd5094bb0c9559"
server_key_iv: "f63be6824e661557fc6902f1b586dd82"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:13.276969 14014 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.000s
I20260810 14:32:13.294741 14036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:13.296419 14014 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260810 14:32:13.296567 14014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "7e2c2a6a24e34ebca096a4e39f65548e"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "f4dd248d4058f3f8bbdd5094bb0c9559"
server_key_iv: "f63be6824e661557fc6902f1b586dd82"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:13.296730 14014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:32:13.313848 14014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:32:13.317339 14014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:32:13.317615 14014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:32:13.318413 14014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:32:13.321049 14014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:32:13.321175 14014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:13.321322 14014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:32:13.321416 14014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:13.333108 14014 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:46379
I20260810 14:32:13.334452 14014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:32:13.342404 14163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:46379 every 8 connection(s)
I20260810 14:32:13.344132 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 14014
I20260810 14:32:13.344309 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:32:13.344624 1849 external_mini_cluster.cc:1428] Setting key def70ea76a72d9d291f77abe9126bf73
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:32:13.369102 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:13.346036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:32793 (local address 127.1.206.126:40995)
0810 14:32:13.346327 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:13.346338 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:13.346356 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:32:13.349662 (+ 3306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:13.349669 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:13.349748 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:13.349861 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:32:13.351998 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.352712 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.354503 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.354912 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.355049 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:13.363754 (+ 8705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:32:13.363759 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:32:13.363763 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:32:13.363804 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:32:13.366019 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:13.366894 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:13.366898 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:13.366900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:13.367005 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:13.367488 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:13.367492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:13.367494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:13.367784 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:32:13.367868 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:13.368744 (+ 876us) server_negotiation.cc:299] Negotiation successful
0810 14:32:13.368905 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":143,"threads_started":1}
I20260810 14:32:13.371328 14167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:13.344891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:40995 (local address 127.1.206.65:32793)
0810 14:32:13.345583 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:13.345639 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:13.349344 (+ 3705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:13.350526 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:13.350537 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:13.350976 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:32:13.351783 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:13.351807 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.352858 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.352863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:13.354347 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:13.354361 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.355301 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.355307 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:13.355545 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:13.356415 (+ 870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:32:13.356444 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:32:13.361009 (+ 4565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:32:13.366270 (+ 5261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:32:13.366279 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:32:13.366302 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:32:13.366751 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:32:13.367130 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:32:13.367133 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:32:13.367136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:32:13.367363 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:32:13.367970 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:32:13.367978 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:32:13.368412 (+ 434us) client_negotiation.cc:769] Sending connection context
0810 14:32:13.369644 (+ 1232us) client_negotiation.cc:240] Negotiation successful
0810 14:32:13.370050 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":175,"threads_started":1}
I20260810 14:32:13.373296 14164 heartbeater.cc:347] Connected to a master server at 127.1.206.126:40995
I20260810 14:32:13.373557 14164 heartbeater.cc:464] Registering TS with master...
I20260810 14:32:13.374274 14164 heartbeater.cc:511] Master 127.1.206.126:40995 requested a full tablet report, sending...
I20260810 14:32:13.376415 13922 ts_manager.cc:194] Registered new tserver with Master: 7e2c2a6a24e34ebca096a4e39f65548e (127.1.206.65:46379)
I20260810 14:32:13.378070 13922 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:32793
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:32:13.400113 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:34073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:40995
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 14:32:13.558533 14172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:32:13.558970 14172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:32:13.559057 14172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:32:13.566380 14172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:32:13.566497 14172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:32:13.566596 14172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:32:13.575356 14172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.206.84:34073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:40995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:32:13.577142 14172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:32:13.578743 14172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:32:13.592586 14179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:13.592585 14181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:13.592607 14178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:32:13.593366 14172 server_base.cc:1034] running on GCE node
I20260810 14:32:13.593858 14172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:32:13.594535 14172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:32:13.595728 14172 hybrid_clock.cc:648] HybridClock initialized: now 1786372333595697 us; error 50 us; skew 500 ppm
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:32:13.599138 14172 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:32:13.600419 14172 webserver.cc:460] Webserver started at http://127.1.206.66:36881/ using document root <none> and password file <none>
I20260810 14:32:13.601181 14172 fs_manager.cc:359] Metadata directory not provided
I20260810 14:32:13.601286 14172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:32:13.601608 14172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:13.617017 14172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "4a65b94e665f44658f26306d16493545"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "789170d00141853aadd1d3c00797780f"
server_key_iv: "8a0db64f7c564f3c218124805f21a110"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:13.617988 14172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "4a65b94e665f44658f26306d16493545"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "789170d00141853aadd1d3c00797780f"
server_key_iv: "8a0db64f7c564f3c218124805f21a110"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:13.623931 14172 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 14:32:13.648723 14189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:13.650808 14172 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260810 14:32:13.650982 14172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "4a65b94e665f44658f26306d16493545"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "789170d00141853aadd1d3c00797780f"
server_key_iv: "8a0db64f7c564f3c218124805f21a110"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:13.651178 14172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:32:13.668702 14172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:32:13.672628 14172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:32:13.672852 14172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:32:13.673635 14172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:32:13.674789 14172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:32:13.674863 14172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:13.674927 14172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:32:13.674960 14172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:13.686849 14172 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:34563
I20260810 14:32:13.687856 14172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:32:13.688719 14313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:34563 every 8 connection(s)
I20260810 14:32:13.692700 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 14172
I20260810 14:32:13.692848 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:32:13.693145 1849 external_mini_cluster.cc:1428] Setting key 52bb5afa2b6baf1087fbf9ea2dbd5225
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:32:13.710232 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:13.691158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:39391 (local address 127.1.206.126:40995)
0810 14:32:13.691324 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:13.691331 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:13.691873 (+ 542us) server_negotiation.cc:407] Connection header received
0810 14:32:13.693154 (+ 1281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:13.693160 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:13.693223 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:13.693288 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:32:13.695774 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.696641 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.698476 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.698882 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.699001 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:13.705329 (+ 6328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:32:13.705333 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:32:13.705335 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:32:13.705364 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:32:13.707159 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:13.707925 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:13.707930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:13.707932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:13.708039 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:13.708616 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:13.708620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:13.708622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:13.708890 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:32:13.709003 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:13.709853 (+ 850us) server_negotiation.cc:299] Negotiation successful
0810 14:32:13.710023 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:32:13.712440 14316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:13.690738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:40995 (local address 127.1.206.66:39391)
0810 14:32:13.691644 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:13.691713 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:13.692866 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:13.693759 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:13.693768 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:13.694763 (+ 995us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:32:13.695566 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:13.695589 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.696824 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.696827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:13.698322 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:13.698335 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:13.699241 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:13.699245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:13.699454 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:13.701551 (+ 2097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:32:13.701574 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:32:13.705070 (+ 3496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:32:13.707341 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:32:13.707348 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:32:13.707369 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:32:13.707763 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:32:13.708168 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:32:13.708172 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:32:13.708174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:32:13.708453 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:32:13.709069 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:32:13.709077 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:32:13.709472 (+ 395us) client_negotiation.cc:769] Sending connection context
0810 14:32:13.710778 (+ 1306us) client_negotiation.cc:240] Negotiation successful
0810 14:32:13.711211 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":143,"threads_started":1}
I20260810 14:32:13.713984 14314 heartbeater.cc:347] Connected to a master server at 127.1.206.126:40995
I20260810 14:32:13.714293 14314 heartbeater.cc:464] Registering TS with master...
I20260810 14:32:13.715127 14314 heartbeater.cc:511] Master 127.1.206.126:40995 requested a full tablet report, sending...
I20260810 14:32:13.716760 13922 ts_manager.cc:194] Registered new tserver with Master: 4a65b94e665f44658f26306d16493545 (127.1.206.66:34563)
I20260810 14:32:13.717700 13922 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:39391
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:32:13.732632 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:34073/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:40995
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:32:13.904282 14319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:32:13.904703 14319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:32:13.904767 14319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:32:13.911051 14319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:32:13.911239 14319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:32:13.911379 14319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:32:13.919344 14319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.206.84:34073/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:40995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:32:13.920835 14319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:32:13.922211 14319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
W20260810 14:32:13.935587 14326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:13.936148 14325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:13.936692 14329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:32:13.937628 14319 server_base.cc:1034] running on GCE node
I20260810 14:32:13.938169 14319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:32:13.939040 14319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:32:13.946470 14319 hybrid_clock.cc:648] HybridClock initialized: now 1786372333946373 us; error 106 us; skew 500 ppm
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:32:13.951212 14319 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:32:13.952884 14319 webserver.cc:460] Webserver started at http://127.1.206.67:38429/ using document root <none> and password file <none>
I20260810 14:32:13.953733 14319 fs_manager.cc:359] Metadata directory not provided
I20260810 14:32:13.953898 14319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:32:13.954214 14319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:32:13 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:14.000993 14319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "030debc820e9471593830f06700065bf"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "ab049972b47d1bca9ac2bf7446462c33"
server_key_iv: "7aca4de672f3ba46f68c58d44c7d42b5"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:14.001969 14319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "030debc820e9471593830f06700065bf"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "ab049972b47d1bca9ac2bf7446462c33"
server_key_iv: "7aca4de672f3ba46f68c58d44c7d42b5"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:14.007153 14319 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 14:32:14.023957 14338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:14.025866 14319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 14:32:14.026011 14319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "030debc820e9471593830f06700065bf"
format_stamp: "Formatted at 2026-08-10 14:32:13 on dist-test-slave-0b58"
server_key: "ab049972b47d1bca9ac2bf7446462c33"
server_key_iv: "7aca4de672f3ba46f68c58d44c7d42b5"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:14.026177 14319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:32:14.038584 14319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:32:14.041895 14319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:32:14.042084 14319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:32:14.042726 14319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:32:14.043730 14319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:32:14.043802 14319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:14.043852 14319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:32:14.043880 14319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:14.054548 14319 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:42831
I20260810 14:32:14.054802 14464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:42831 every 8 connection(s)
I20260810 14:32:14.055612 14319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:32:14.064934 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 14319
I20260810 14:32:14.065084 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:32:14.065349 1849 external_mini_cluster.cc:1428] Setting key 812eb3589e5731e0b0e8955e6c6c0619
Aug 10 14:32:14 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:32:14.071959 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.057879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:53033 (local address 127.1.206.126:40995)
0810 14:32:14.058030 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.058035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.058984 (+ 949us) server_negotiation.cc:407] Connection header received
0810 14:32:14.060229 (+ 1245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.060232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.060337 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.060415 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:32:14.061915 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.062651 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.064401 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.064746 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.064901 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.067849 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:32:14.067853 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:32:14.067855 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:32:14.067883 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:32:14.069577 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:14.070202 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:14.070206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:14.070208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:14.070296 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:14.070708 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:14.070712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:14.070714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:14.070922 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:32:14.071037 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.071621 (+ 584us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.071778 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 14:32:14.072978 14467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.058250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:40995 (local address 127.1.206.67:53033)
0810 14:32:14.058812 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:14.058875 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:14.059987 (+ 1112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:14.060623 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:14.060632 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:14.061015 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:32:14.061707 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.061727 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.062813 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.062817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.064186 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.064198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.064948 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.064952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.065200 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.066003 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:32:14.066021 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:32:14.067652 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:32:14.069730 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:32:14.069737 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:32:14.069757 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:32:14.070068 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:32:14.070402 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:32:14.070405 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:32:14.070408 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:32:14.070599 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:32:14.071037 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:32:14.071045 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:32:14.071362 (+ 317us) client_negotiation.cc:769] Sending connection context
0810 14:32:14.071576 (+ 214us) client_negotiation.cc:240] Negotiation successful
0810 14:32:14.071931 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":124,"threads_started":1}
I20260810 14:32:14.074658 14465 heartbeater.cc:347] Connected to a master server at 127.1.206.126:40995
I20260810 14:32:14.074959 14465 heartbeater.cc:464] Registering TS with master...
I20260810 14:32:14.075524 14465 heartbeater.cc:511] Master 127.1.206.126:40995 requested a full tablet report, sending...
I20260810 14:32:14.076833 13922 ts_manager.cc:194] Registered new tserver with Master: 030debc820e9471593830f06700065bf (127.1.206.67:42831)
I20260810 14:32:14.077461 13922 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:53033
I20260810 14:32:14.079906 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:32:14.090709 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.082348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33832 (local address 127.1.206.126:40995)
0810 14:32:14.082593 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.082597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.082766 (+ 169us) server_negotiation.cc:407] Connection header received
0810 14:32:14.082967 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.082970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.083017 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.083113 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:32:14.084007 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.084637 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.085517 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.085751 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.085874 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.087391 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:32:14.087395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:32:14.087398 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:32:14.087426 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:32:14.089049 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:14.089488 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:14.089493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:14.089495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:14.089580 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:14.089860 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:14.089864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:14.089866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:14.090047 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:32:14.090188 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.090424 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.090543 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260810 14:32:14.094403 13922 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:32:14.097867 13922 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:32:14.118708 14479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.107360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54634 (local address 127.1.206.66:34563)
0810 14:32:14.110288 (+ 2928us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.110297 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.110315 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:32:14.110375 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.110379 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.110535 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.110732 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:32:14.111822 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.113084 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.116134 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.116989 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.117071 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.117206 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.117658 (+ 452us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.118494 (+ 836us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2838,"thread_start_us":107,"threads_started":1}
I20260810 14:32:14.119302 14481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.108302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39892 (local address 127.1.206.65:46379)
0810 14:32:14.109903 (+ 1601us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.109907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.111096 (+ 1189us) server_negotiation.cc:407] Connection header received
0810 14:32:14.111318 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.111326 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.111510 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.111626 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:32:14.112389 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.113495 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.114873 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.115689 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.115770 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.115907 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.118967 (+ 3060us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.119156 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1507,"thread_start_us":122,"threads_started":1}
I20260810 14:32:14.119480 14480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.107235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:34563 (local address 127.0.0.1:54634)
0810 14:32:14.109309 (+ 2074us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:14.109935 (+ 626us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:14.110046 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:14.111474 (+ 1428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:14.111481 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:14.111505 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:32:14.111675 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.111684 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.113279 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.113282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.115974 (+ 2692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.115981 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.117299 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.117302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.117442 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.117488 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:32:14.119186 (+ 1698us) client_negotiation.cc:240] Negotiation successful
0810 14:32:14.119325 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1881,"mutex_wait_us":4,"thread_start_us":115,"threads_started":1}
I20260810 14:32:14.122387 14241 tablet_service.cc:1467] Processing CreateTablet for tablet ce18980d4a154cffa5b32a32bdcf687f (DEFAULT_TABLE table=test-table [id=dfcfe5e78fc946afac574e84e4a534e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:32:14.123443 14483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.107875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:46379 (local address 127.0.0.1:39892)
0810 14:32:14.111000 (+ 3125us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:14.111015 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:14.111162 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:14.111813 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:14.111815 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:14.111833 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:32:14.111951 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.111957 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.113633 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.113636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.114739 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.114751 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.118680 (+ 3929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.118683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.118794 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.118823 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 14:32:14.119775 (+ 952us) client_negotiation.cc:240] Negotiation successful
0810 14:32:14.123313 (+ 3538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3060,"thread_start_us":103,"threads_started":1}
I20260810 14:32:14.123644 14241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce18980d4a154cffa5b32a32bdcf687f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:32:14.125393 14478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.109050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:42831 (local address 127.0.0.1:42082)
0810 14:32:14.112142 (+ 3092us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:14.112155 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:14.112238 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:14.115964 (+ 3726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:14.115968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:14.115988 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:32:14.116109 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.116118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.117466 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.117469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.118521 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.118532 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.124967 (+ 6435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.124971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.125073 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.125098 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 14:32:14.125188 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 14:32:14.125262 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3033,"thread_start_us":105,"threads_started":1}
I20260810 14:32:14.125882 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.109473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.1.206.67:42831)
0810 14:32:14.109791 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.109803 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.114712 (+ 4909us) server_negotiation.cc:407] Connection header received
0810 14:32:14.114812 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.114818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.115014 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.115178 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:32:14.116244 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.117344 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.123625 (+ 6281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.124654 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.124763 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.124901 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.125641 (+ 740us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.125745 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":136,"threads_started":1}
I20260810 14:32:14.127398 14088 tablet_service.cc:1467] Processing CreateTablet for tablet ce18980d4a154cffa5b32a32bdcf687f (DEFAULT_TABLE table=test-table [id=dfcfe5e78fc946afac574e84e4a534e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:32:14.128659 14088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce18980d4a154cffa5b32a32bdcf687f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:32:14.128772 14391 tablet_service.cc:1467] Processing CreateTablet for tablet ce18980d4a154cffa5b32a32bdcf687f (DEFAULT_TABLE table=test-table [id=dfcfe5e78fc946afac574e84e4a534e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:32:14.129889 14391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce18980d4a154cffa5b32a32bdcf687f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:32:14.138674 14486 tablet_bootstrap.cc:492] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Bootstrap starting.
I20260810 14:32:14.141666 14486 tablet_bootstrap.cc:654] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Neither blocks nor log segments found. Creating new log.
I20260810 14:32:14.142177 14485 tablet_bootstrap.cc:492] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e: Bootstrap starting.
I20260810 14:32:14.144601 14485 tablet_bootstrap.cc:654] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e: Neither blocks nor log segments found. Creating new log.
I20260810 14:32:14.145596 14486 log.cc:824] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Log is configured to *not* fsync() on all Append() calls
I20260810 14:32:14.146915 14485 log.cc:824] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:32:14.148154 14487 tablet_bootstrap.cc:492] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Bootstrap starting.
I20260810 14:32:14.149320 14486 tablet_bootstrap.cc:492] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: No bootstrap required, opened a new log
I20260810 14:32:14.149617 14486 ts_tablet_manager.cc:1397] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260810 14:32:14.151276 14487 tablet_bootstrap.cc:654] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Neither blocks nor log segments found. Creating new log.
I20260810 14:32:14.153355 14485 tablet_bootstrap.cc:492] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e: No bootstrap required, opened a new log
I20260810 14:32:14.153644 14485 ts_tablet_manager.cc:1397] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260810 14:32:14.154129 14486 raft_consensus.cc:348] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.154537 14486 raft_consensus.cc:374] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:32:14.154675 14486 raft_consensus.cc:729] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030debc820e9471593830f06700065bf, State: Initialized, Role: FOLLOWER
I20260810 14:32:14.155287 14486 consensus_queue.cc:260] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.156920 14486 ts_tablet_manager.cc:1428] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 14:32:14.157608 14465 heartbeater.cc:503] Master 127.1.206.126:40995 was elected leader, sending a full tablet report...
I20260810 14:32:14.158689 14485 raft_consensus.cc:348] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.160087 14487 log.cc:824] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Log is configured to *not* fsync() on all Append() calls
I20260810 14:32:14.160307 14485 raft_consensus.cc:374] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:32:14.160418 14485 raft_consensus.cc:729] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2a6a24e34ebca096a4e39f65548e, State: Initialized, Role: FOLLOWER
I20260810 14:32:14.161001 14485 consensus_queue.cc:260] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.162285 14485 ts_tablet_manager.cc:1428] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260810 14:32:14.162700 14164 heartbeater.cc:503] Master 127.1.206.126:40995 was elected leader, sending a full tablet report...
I20260810 14:32:14.165508 14487 tablet_bootstrap.cc:492] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: No bootstrap required, opened a new log
I20260810 14:32:14.165843 14487 ts_tablet_manager.cc:1397] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260810 14:32:14.170115 14487 raft_consensus.cc:348] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.170461 14487 raft_consensus.cc:374] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:32:14.170559 14487 raft_consensus.cc:729] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a65b94e665f44658f26306d16493545, State: Initialized, Role: FOLLOWER
I20260810 14:32:14.171099 14487 consensus_queue.cc:260] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.171967 14314 heartbeater.cc:503] Master 127.1.206.126:40995 was elected leader, sending a full tablet report...
I20260810 14:32:14.172410 14487 ts_tablet_manager.cc:1428] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260810 14:32:14.189711 14315 tablet.cc:2369] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:32:14.227943 14491 raft_consensus.cc:482] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:32:14.228561 14491 raft_consensus.cc:504] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.231988 14491 leader_election.cc:288] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a65b94e665f44658f26306d16493545 (127.1.206.66:34563), 030debc820e9471593830f06700065bf (127.1.206.67:42831)
I20260810 14:32:14.238689 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.231484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:42831 (local address 127.1.206.65:43637)
0810 14:32:14.233907 (+ 2423us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:14.233923 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:14.234105 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:14.234542 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:14.234545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:14.234564 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:32:14.234724 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.234731 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.235721 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.235724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.237157 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.237170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.238224 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.238228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.238329 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.238354 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 14:32:14.238426 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 14:32:14.238501 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2338,"thread_start_us":180,"threads_started":1}
I20260810 14:32:14.239447 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.231514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:43637 (local address 127.1.206.67:42831)
0810 14:32:14.231739 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.231744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.234018 (+ 2274us) server_negotiation.cc:407] Connection header received
0810 14:32:14.234265 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.234268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.234322 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.234375 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:32:14.234874 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.235553 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.237320 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.237956 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.238082 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.238138 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.239238 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.239330 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260810 14:32:14.239528 14494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.233191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:34563 (local address 127.1.206.65:56459)
0810 14:32:14.234704 (+ 1513us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:14.234720 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:32:14.234871 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:32:14.235229 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:32:14.235232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:32:14.235248 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:32:14.235367 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.235373 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.236205 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.236208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.237602 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:32:14.237618 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.238922 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.238928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:32:14.239077 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.239113 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 14:32:14.239208 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 14:32:14.239302 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1427,"thread_start_us":136,"threads_started":1}
I20260810 14:32:14.240075 14400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce18980d4a154cffa5b32a32bdcf687f" candidate_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030debc820e9471593830f06700065bf" is_pre_election: true
I20260810 14:32:14.240180 14479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.233634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:56459 (local address 127.1.206.66:34563)
0810 14:32:14.233801 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.233806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.234801 (+ 995us) server_negotiation.cc:407] Connection header received
0810 14:32:14.234987 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.234991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.235042 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.235093 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:32:14.235501 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.236069 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.237794 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.238631 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.238772 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.238847 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.239870 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.239991 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:32:14.240444 14400 raft_consensus.cc:2454] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2a6a24e34ebca096a4e39f65548e in term 0.
I20260810 14:32:14.240899 14261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce18980d4a154cffa5b32a32bdcf687f" candidate_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a65b94e665f44658f26306d16493545" is_pre_election: true
I20260810 14:32:14.241003 14040 leader_election.cc:302] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030debc820e9471593830f06700065bf, 7e2c2a6a24e34ebca096a4e39f65548e; no voters:
I20260810 14:32:14.241243 14261 raft_consensus.cc:2454] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2a6a24e34ebca096a4e39f65548e in term 0.
I20260810 14:32:14.241400 14491 raft_consensus.cc:2781] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:32:14.241505 14491 raft_consensus.cc:482] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:32:14.241575 14491 raft_consensus.cc:3037] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:32:14.242827 14491 raft_consensus.cc:504] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.243268 14491 leader_election.cc:288] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [CANDIDATE]: Term 1 election: Requested vote from peers 4a65b94e665f44658f26306d16493545 (127.1.206.66:34563), 030debc820e9471593830f06700065bf (127.1.206.67:42831)
I20260810 14:32:14.243611 14261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce18980d4a154cffa5b32a32bdcf687f" candidate_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a65b94e665f44658f26306d16493545"
I20260810 14:32:14.243696 14400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce18980d4a154cffa5b32a32bdcf687f" candidate_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030debc820e9471593830f06700065bf"
I20260810 14:32:14.243760 14261 raft_consensus.cc:3037] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:32:14.243848 14400 raft_consensus.cc:3037] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:32:14.245237 14261 raft_consensus.cc:2454] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2a6a24e34ebca096a4e39f65548e in term 1.
I20260810 14:32:14.245244 14400 raft_consensus.cc:2454] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2a6a24e34ebca096a4e39f65548e in term 1.
I20260810 14:32:14.245635 14040 leader_election.cc:302] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030debc820e9471593830f06700065bf, 7e2c2a6a24e34ebca096a4e39f65548e; no voters:
I20260810 14:32:14.245906 14491 raft_consensus.cc:2781] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:32:14.246161 14491 raft_consensus.cc:686] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2a6a24e34ebca096a4e39f65548e, State: Running, Role: LEADER
I20260810 14:32:14.246557 14491 consensus_queue.cc:237] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } }
I20260810 14:32:14.251777 13922 catalog_manager.cc:5495] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2a6a24e34ebca096a4e39f65548e (127.1.206.65). New cstate: current_term: 1 leader_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2a6a24e34ebca096a4e39f65548e" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 } health_report { overall_health: UNKNOWN } } }
Aug 10 14:32:14 dist-test-slave-0b58 krb5kdc[13390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372333, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:14.276012 14481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.270247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39904 (local address 127.1.206.65:46379)
0810 14:32:14.270432 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:14.270435 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:14.270447 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:32:14.270532 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:14.270534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:14.270587 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:14.270719 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:32:14.271163 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.271989 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.273373 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:14.273821 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:14.273937 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:14.274466 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:32:14.275082 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:32:14.275219 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:14.275779 (+ 560us) server_negotiation.cc:299] Negotiation successful
0810 14:32:14.275853 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 14:32:14.284695 14400 raft_consensus.cc:1261] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 1 FOLLOWER]: Refusing update from remote peer 7e2c2a6a24e34ebca096a4e39f65548e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:32:14.284695 14261 raft_consensus.cc:1261] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 1 FOLLOWER]: Refusing update from remote peer 7e2c2a6a24e34ebca096a4e39f65548e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:32:14.285524 14491 consensus_queue.cc:1035] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [LEADER]: Connected to new peer: Peer: permanent_uuid: "030debc820e9471593830f06700065bf" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 42831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:32:14.286386 14498 consensus_queue.cc:1035] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a65b94e665f44658f26306d16493545" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 34563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:32:14.298300 14502 mvcc.cc:205] Tried to move back new op lower bound from 7316981081219293184 to 7316981081077944320. Current Snapshot: MvccSnapshot[applied={T|T < 7316981081219293184}]
I20260810 14:32:14.302822 14503 mvcc.cc:205] Tried to move back new op lower bound from 7316981081219293184 to 7316981081077944320. Current Snapshot: MvccSnapshot[applied={T|T < 7316981081219293184}]
I20260810 14:32:14.303256 14504 mvcc.cc:205] Tried to move back new op lower bound from 7316981081219293184 to 7316981081077944320. Current Snapshot: MvccSnapshot[applied={T|T < 7316981081219293184}]
I20260810 14:32:14.315481 13922 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:32:14.315693 13922 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:32:14.318749 13922 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 84ecd3868e7348eb93ed6ffb135b6417: Sending DeleteTablet for 3 replicas of tablet ce18980d4a154cffa5b32a32bdcf687f
I20260810 14:32:14.319885 14391 tablet_service.cc:1514] Processing DeleteTablet for tablet ce18980d4a154cffa5b32a32bdcf687f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:32:14 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:42082
I20260810 14:32:14.320078 14241 tablet_service.cc:1514] Processing DeleteTablet for tablet ce18980d4a154cffa5b32a32bdcf687f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:32:14 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:54634
I20260810 14:32:14.320524 14512 tablet_replica.cc:330] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: stopping tablet replica
I20260810 14:32:14.320603 14088 tablet_service.cc:1514] Processing DeleteTablet for tablet ce18980d4a154cffa5b32a32bdcf687f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:32:14 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:39892
I20260810 14:32:14.320888 14512 raft_consensus.cc:2229] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:32:14.321168 14514 tablet_replica.cc:330] T ce18980d4a154cffa5b32a32bdcf687f P 7e2c2a6a24e34ebca096a4e39f65548e: stopping tablet replica
I20260810 14:32:14.321255 14512 raft_consensus.cc:2258] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:32:14.321499 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 14014
I20260810 14:32:14.328820 14513 tablet_replica.cc:330] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: stopping tablet replica
I20260810 14:32:14.329423 14513 raft_consensus.cc:2229] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:32:14.329918 14513 raft_consensus.cc:2258] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:32:14.330073 14512 ts_tablet_manager.cc:1905] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:32:14.331842 14513 ts_tablet_manager.cc:1905] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:32:14.332964 14512 ts_tablet_manager.cc:1918] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:32:14.333047 14512 log.cc:1196] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/ce18980d4a154cffa5b32a32bdcf687f
I20260810 14:32:14.333426 14512 ts_tablet_manager.cc:1939] T ce18980d4a154cffa5b32a32bdcf687f P 030debc820e9471593830f06700065bf: Deleting consensus metadata
I20260810 14:32:14.334685 13907 catalog_manager.cc:4841] TS 030debc820e9471593830f06700065bf (127.1.206.67:42831): tablet ce18980d4a154cffa5b32a32bdcf687f (table test-table [id=dfcfe5e78fc946afac574e84e4a534e6]) successfully deleted
I20260810 14:32:14.335646 14513 ts_tablet_manager.cc:1918] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:32:14.335767 14513 log.cc:1196] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/ce18980d4a154cffa5b32a32bdcf687f
I20260810 14:32:14.336117 14513 ts_tablet_manager.cc:1939] T ce18980d4a154cffa5b32a32bdcf687f P 4a65b94e665f44658f26306d16493545: Deleting consensus metadata
I20260810 14:32:14.337635 13903 catalog_manager.cc:4841] TS 4a65b94e665f44658f26306d16493545 (127.1.206.66:34563): tablet ce18980d4a154cffa5b32a32bdcf687f (table test-table [id=dfcfe5e78fc946afac574e84e4a534e6]) successfully deleted
W20260810 14:32:14.338621 13904 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:46379 (error 108)
I20260810 14:32:14.339520 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 14172
I20260810 14:32:14.339864 14478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:14.339482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:46379 (local address 127.0.0.1:39906)
0810 14:32:14.339666 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 14:32:14.339758 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:46379: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260810 14:32:14.344696 13904 catalog_manager.cc:4584] TS 7e2c2a6a24e34ebca096a4e39f65548e (127.1.206.65:46379): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ce18980d4a154cffa5b32a32bdcf687f: Network error: Client connection negotiation failed: client connection to 127.1.206.65:46379: connect: Connection refused (error 111)
I20260810 14:32:14.351657 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 14319
I20260810 14:32:14.359782 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 13887
I20260810 14:32:14.373728 1849 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 14:32:14.719503 1849 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 14:32:14.719650 1849 mini_ranger.cc:66] Stopping Ranger...
I20260810 14:32:15.065631 1849 mini_ranger.cc:68] Stopped Ranger
2026-08-10 14:32:15.065 UTC [13424] LOG: received smart shutdown request
2026-08-10 14:32:15.070 UTC [13424] LOG: background worker "logical replication launcher" (PID 13434) exited with exit code 1
2026-08-10 14:32:15.071 UTC [13429] LOG: shutting down
2026-08-10 14:32:15.250 UTC [13424] LOG: database system is shut down
2026-08-10T14:32:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48434 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:32:15 dist-test-slave-0b58 krb5kdc[14527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:32:15 dist-test-slave-0b58 krb5kdc[14527](info): set up 2 sockets
Aug 10 14:32:15 dist-test-slave-0b58 krb5kdc[14527](info): commencing operation
krb5kdc: starting...
W20260810 14:32:16.495716 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:32:16 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372336, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:32:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:32:16Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/rangeradmin_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/rangeradmin_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/rangerlookup_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/rangerlookup_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
I20260810 14:32:16.678249 1849 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskN56qvq/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/postgres -l logfile start
2026-08-10 14:32:19.266 UTC [14561] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 14:32:19.267 UTC [14561] LOG: listening on IPv4 address "127.1.206.84", port 51297
2026-08-10 14:32:19.270 UTC [14561] LOG: listening on Unix socket "/tmp/.s.PGSQL.51297"
2026-08-10 14:32:19.305 UTC [14564] LOG: database system was shut down at 2026-08-10 14:32:17 UTC
2026-08-10 14:32:19.310 UTC [14561] LOG: database system is ready to accept connections
I20260810 14:32:20.303848 1849 mini_postgres.cc:96] Postgres bound to 51297
2026-08-10 14:32:20.311 UTC [14572] FATAL: database "slave" does not exist
127.1.206.84:51297 - accepting connections
I20260810 14:32:20.311780 1849 mini_ranger.cc:161] Starting Ranger...
I20260810 14:32:20.328341 1849 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 14:32:20.806285 1849 mini_ranger.cc:87] Created ranger Postgres database
I20260810 14:32:20.806404 1849 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-admin
2026-08-10 14:32:21,112 [I] DB FLAVOR :POSTGRES
2026-08-10 14:32:21,112 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:32:21,113 [I] Checking connection..
2026-08-10 14:32:21,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 14:32:21,358 [I] Checking connection passed.
2026-08-10 14:32:21,358 [I] --------- Verifying version history table ---------
2026-08-10 14:32:21,359 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:32:21,629 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:32:21,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:32:21,898 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:32:21,898 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 14:32:21,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 14:32:22.174 UTC [14646] WARNING: there is no transaction in progress
2026-08-10 14:32:22,182 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 14:32:22,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:32:22,442 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 14:32:22,443 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:32:22,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 14:32:22,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 14:32:22,951 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-0b58.c.gcp-upstream.internal','N') ;"
2026-08-10 14:32:23,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:32:23,472 [I] Table x_portal_user does not exist in database ranger
2026-08-10 14:32:23,473 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:32:23,730 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 14:32:23,731 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:32:24,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:32:24,290 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 14:32:24,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 14:32:25.256 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.272 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.290 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.306 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.322 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.340 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.396 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.403 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.419 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.431 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.442 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.456 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.466 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.472 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.480 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:25.487 UTC [14778] WARNING: there is no transaction in progress
2026-08-10 14:32:26,136 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 14:32:26,136 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 14:32:26,367 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 14:32:26,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:32:26,612 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 14:32:26,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:32:26,874 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 14:32:26,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:32:27,126 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:32:27,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-0b58.c.gcp-upstream.internal';"
2026-08-10 14:32:27,630 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 14:32:27,630 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 14:32:27,872 [I] DB_PATCHES have already been applied
I20260810 14:32:27.879189 1849 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-admin:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskN56qvq/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 14:32:27.879297 1849 mini_ranger.cc:193] Using host: 127.1.206.84
I20260810 14:32:27.883826 1849 mini_ranger.cc:227] Ranger admin URL: http://127.1.206.84:55189
Aug 10, 2026 2:32:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:32:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:32:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 2:32:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 2:32:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 2:32:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 2:32:28 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 14:32:29.071303 1849 mini_ranger.cc:160] Time spent starting Ranger: real 8.760s user 0.000s sys 0.013s
Aug 10, 2026 2:32:48 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 2:32:48 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 10, 2026 2:32:48 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 2:32:49 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 2:32:49 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 14:32:50.512774 1849 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.206.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.206.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/rangerkms_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.206.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/rangerkms_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.206.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.206.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.206.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/HTTP_127.1.206.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 14:32:50 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372370, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 14:32:50.609464 1849 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 14:32:50.621040 1849 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 14:32:51.446554 1849 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 14:32:51.446655 1849 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms
I20260810 14:32:51.446673 1849 mini_ranger_kms.cc:227] Using postgres at 127.1.206.84:51297
2026-08-10 14:32:51,668 [I] DB FLAVOR :POSTGRES
2026-08-10 14:32:51,668 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:32:51,668 [I] Checking connection
2026-08-10 14:32:51,668 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 14:32:51,983 [I] connection success
2026-08-10 14:32:51,983 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 14:32:51,983 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 14:32:51,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 14:32:52,246 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 14:32:52,246 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:32:52,247 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 14:32:52,247 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.206.84:51297/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 14:32:52,542 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 14:32:53.055604 1849 mini_ranger_kms.cc:310] Created kms service
I20260810 14:32:53.281963 1849 mini_ranger_kms.cc:326] Created kudu user
I20260810 14:32:53.335566 1849 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 14:32:53 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372370, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:53.733192 1849 mini_ranger_kms.cc:384] Added ranger policy
I20260810 14:32:53.733345 1849 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms:/tmp/dist-test-taskN56qvq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskN56qvq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 14:32:53.733366 1849 mini_ranger_kms.cc:240] Using host: 127.1.206.84
I20260810 14:32:53.738662 1849 mini_ranger_kms.cc:276] Ranger KMS PID: 14981
I20260810 14:32:53.738775 1849 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.206.84:48095
Aug 10, 2026 2:32:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:32:54 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:32:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 2:32:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 2:32:55 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 2:32:55 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 14:32:55 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786372375, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.206.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:32:56.114849 1849 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.505s user 0.030s sys 0.176s
I20260810 14:32:56.114995 1849 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 14:32:56.115073 1849 mini_ranger_kms.cc:401] 127.1.206.84:48095/kms/v1/keys
Aug 10 14:32:56 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372375, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.206.84@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
Aug 10 14:32:56 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372375, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.206.84@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
Aug 10 14:32:59 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:32:59.099768 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:46139
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:46139
--ranger_config_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:32:59.236614 15040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:32:59.236904 15040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:32:59.236980 15040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:32:59.241498 15040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:32:59.241573 15040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:32:59.241593 15040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:32:59.241611 15040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:32:59.241657 15040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:32:59.247762 15040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.206.84:48095/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:46139
--ranger_config_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:46139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:32:59.249068 15040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:32:59.250164 15040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:32:59.259174 15046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:59.259181 15045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:32:59.259200 15049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:32:59.259485 15040 server_base.cc:1034] running on GCE node
I20260810 14:32:59.260206 15040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:32:59.261418 15040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:32:59.262617 15040 hybrid_clock.cc:648] HybridClock initialized: now 1786372379262603 us; error 26 us; skew 500 ppm
Aug 10 14:32:59 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372379, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:32:59.265621 15040 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:32:59.266604 15040 webserver.cc:460] Webserver started at http://127.1.206.126:38907/ using document root <none> and password file <none>
I20260810 14:32:59.267201 15040 fs_manager.cc:359] Metadata directory not provided
I20260810 14:32:59.267287 15040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:32:59.267539 15040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:32:59 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372379, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:32:59.318507 15040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "811c6d6a84b342aea20a63a8e32dcb5b"
format_stamp: "Formatted at 2026-08-10 14:32:59 on dist-test-slave-0b58"
server_key: "f4a8d8696a354e6699a0bf1722ac22fa"
server_key_iv: "123940c138e6678f46455a8eb56d2d42"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:59.319283 15040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "811c6d6a84b342aea20a63a8e32dcb5b"
format_stamp: "Formatted at 2026-08-10 14:32:59 on dist-test-slave-0b58"
server_key: "f4a8d8696a354e6699a0bf1722ac22fa"
server_key_iv: "123940c138e6678f46455a8eb56d2d42"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:59.323542 15040 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 14:32:59.338434 15056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:32:59.339967 15040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:32:59.340122 15040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "811c6d6a84b342aea20a63a8e32dcb5b"
format_stamp: "Formatted at 2026-08-10 14:32:59 on dist-test-slave-0b58"
server_key: "f4a8d8696a354e6699a0bf1722ac22fa"
server_key_iv: "123940c138e6678f46455a8eb56d2d42"
server_key_version: "kuduclusterkey@0"
I20260810 14:32:59.340350 15040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:32:59.358503 15040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:32:59.362022 15040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:32:59.362314 15040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:32:59.372758 15040 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:46139
I20260810 14:32:59.372768 15117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:46139 every 8 connection(s)
I20260810 14:32:59.373956 15040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:32:59.377734 15118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:32:59.380456 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 15040
I20260810 14:32:59.380645 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:32:59.380972 1849 external_mini_cluster.cc:1428] Setting key de82f243401f644cb38a953d088608d0
I20260810 14:32:59.385347 15118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Bootstrap starting.
I20260810 14:32:59.388236 15118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Neither blocks nor log segments found. Creating new log.
I20260810 14:32:59.389246 15118 log.cc:824] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:32:59 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:32:59.391476 15118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: No bootstrap required, opened a new log
I20260810 14:32:59.396167 15118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:32:59.396498 15118 raft_consensus.cc:374] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:32:59.396589 15118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811c6d6a84b342aea20a63a8e32dcb5b, State: Initialized, Role: FOLLOWER
I20260810 14:32:59.396968 15121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:32:59.382590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38434 (local address 127.1.206.126:46139)
0810 14:32:59.383059 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 14:32:59.383076 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:32:59.383114 (+ 38us) server_negotiation.cc:407] Connection header received
0810 14:32:59.383994 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:32:59.384016 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:32:59.384452 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:32:59.384808 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:32:59.385731 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:59.386711 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:59.387595 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:32:59.388079 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:32:59.388287 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:32:59.391271 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:32:59.391278 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:32:59.391295 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:32:59.391326 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:32:59.393552 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:59.394091 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:59.394100 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:59.394107 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:59.394259 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:32:59.394591 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:32:59.394595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:32:59.394597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:32:59.395135 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:32:59.395351 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 14:32:59.395666 (+ 315us) server_negotiation.cc:299] Negotiation successful
0810 14:32:59.395951 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":155,"threads_started":1}
I20260810 14:32:59.397112 15118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:32:59.397300 15118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:32:59.397384 15118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:32:59.397583 15118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:32:59.398792 15118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:32:59.399165 15118 leader_election.cc:302] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 811c6d6a84b342aea20a63a8e32dcb5b; no voters:
I20260810 14:32:59.399560 15118 leader_election.cc:288] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:32:59.399717 15123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:32:59.399926 15123 raft_consensus.cc:686] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 LEADER]: Becoming Leader. State: Replica: 811c6d6a84b342aea20a63a8e32dcb5b, State: Running, Role: LEADER
I20260810 14:32:59.400348 15123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:32:59.400815 15118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:32:59.401755 15123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 811c6d6a84b342aea20a63a8e32dcb5b. Latest consensus state: current_term: 1 leader_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } } }
I20260810 14:32:59.401965 15123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: This master's current role is: LEADER
I20260810 14:32:59.402145 15124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } } }
I20260810 14:32:59.402316 15124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: This master's current role is: LEADER
I20260810 14:32:59.402423 15134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:32:59.406387 15134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:32:59.406870 15118 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 14:32:59.417716 15134 catalog_manager.cc:1347] Generated new cluster ID: c4a0e8d82c57436a902690299528c209
I20260810 14:32:59.417846 15134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:32:59.428172 15134 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:32:59.429647 15134 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:32:59.436558 15134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Generated new TSK 0
I20260810 14:32:59.437495 15134 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:33:00.200135 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:46139
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:00.329909 15170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:00.330298 15170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:00.330364 15170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:00.334905 15170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:00.334971 15170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:00.335034 15170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:33:00.340623 15170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.206.84:48095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:46139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:00.341796 15170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:00.342891 15170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:00.354261 15180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:00.354261 15178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:00.354856 15177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:00.356098 15170 server_base.cc:1034] running on GCE node
I20260810 14:33:00.356621 15170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:00.357339 15170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:00.360704 15170 hybrid_clock.cc:648] HybridClock initialized: now 1786372380360666 us; error 54 us; skew 500 ppm
Aug 10 14:33:00 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:00.364450 15170 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:33:00.365527 15170 webserver.cc:460] Webserver started at http://127.1.206.65:40361/ using document root <none> and password file <none>
I20260810 14:33:00.366250 15170 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:00.366389 15170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:00.366662 15170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:33:00 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:00.387774 15170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "29192b9b9e0b4f52ac2467edf3f89a02"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "aaeb9100237291337fb08c28f51c2d7d"
server_key_iv: "08c41e2a0d31f75466e0f1725a64304b"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:00.393337 15170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "29192b9b9e0b4f52ac2467edf3f89a02"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "aaeb9100237291337fb08c28f51c2d7d"
server_key_iv: "08c41e2a0d31f75466e0f1725a64304b"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:00.399345 15170 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 14:33:00.417539 15189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:00.419417 15170 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:33:00.419577 15170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "29192b9b9e0b4f52ac2467edf3f89a02"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "aaeb9100237291337fb08c28f51c2d7d"
server_key_iv: "08c41e2a0d31f75466e0f1725a64304b"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:00.419742 15170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:00.455780 15170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:00.468096 15170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:00.468351 15170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:00.469082 15170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:00.470142 15170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:00.470275 15170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:00.470407 15170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:00.470444 15170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:00.495863 15170 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:35357
I20260810 14:33:00.497229 15170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:33:00.498123 15335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:35357 every 8 connection(s)
I20260810 14:33:00.507561 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 15170
I20260810 14:33:00.507738 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:33:00.508080 1849 external_mini_cluster.cc:1428] Setting key 80c1bb2a0958bb19559aa602df360757
Aug 10 14:33:00 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:00.528470 15338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:00.500952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46139 (local address 127.1.206.65:45175)
0810 14:33:00.510051 (+ 9099us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:00.510142 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:00.511306 (+ 1164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:00.512247 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:00.512283 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:00.512665 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:00.513420 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:00.513442 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.514699 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.514715 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:00.516186 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:00.516200 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.518391 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.518398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:00.518642 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:00.520488 (+ 1846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:00.520513 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:00.522435 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:00.524851 (+ 2416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:00.524859 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:00.524881 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:00.525278 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:00.525624 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:00.525627 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:00.525629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:00.525828 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:00.526353 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:00.526361 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:00.526713 (+ 352us) client_negotiation.cc:769] Sending connection context
0810 14:33:00.526929 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 14:33:00.527313 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8781,"thread_start_us":181,"threads_started":1}
I20260810 14:33:00.529423 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:00.502399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:45175 (local address 127.1.206.126:46139)
0810 14:33:00.502874 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:00.502880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:00.511657 (+ 8777us) server_negotiation.cc:407] Connection header received
0810 14:33:00.511725 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:00.511728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:00.511787 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:00.511879 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:00.513616 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.514520 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.517616 (+ 3096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.518042 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.518165 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:00.522719 (+ 4554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:00.522724 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:00.522727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:00.522761 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:00.524692 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:00.525409 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:00.525413 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:00.525415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:00.525517 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:00.525934 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:00.525937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:00.525939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:00.526195 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:00.526296 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:00.529072 (+ 2776us) server_negotiation.cc:299] Negotiation successful
0810 14:33:00.529239 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":110,"threads_started":1}
I20260810 14:33:00.530951 15336 heartbeater.cc:347] Connected to a master server at 127.1.206.126:46139
I20260810 14:33:00.531244 15336 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:00.531880 15336 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:00.533987 15075 ts_manager.cc:194] Registered new tserver with Master: 29192b9b9e0b4f52ac2467edf3f89a02 (127.1.206.65:35357)
I20260810 14:33:00.535682 15075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:45175
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
Aug 10 14:33:00 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:33:00.569301 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:46139
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:00.753355 15343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:00.754299 15343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:00.754469 15343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:00.761343 15343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:00.761603 15343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:00.761781 15343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:33:00.770903 15343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.206.84:48095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:46139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:00.772804 15343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:00.774374 15343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:33:00.789342 15343 server_base.cc:1034] running on GCE node
W20260810 14:33:00.792572 15350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:00.792927 15353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:00.796466 15351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:00.797108 15343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:00.797935 15343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:00.813670 15343 hybrid_clock.cc:648] HybridClock initialized: now 1786372380813487 us; error 206 us; skew 500 ppm
Aug 10 14:33:00 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:00.818403 15343 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:33:00.819832 15343 webserver.cc:460] Webserver started at http://127.1.206.66:38661/ using document root <none> and password file <none>
I20260810 14:33:00.820708 15343 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:00.820885 15343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:00.821231 15343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:33:00 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:00.849566 15343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "58e79383134f4a2697d5c1c06a20423f"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "3ba6d28ccac1d7c32ed65c7557f8980c"
server_key_iv: "f6450636c53b4d113c86a514c88ff2f6"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:00.851970 15343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "58e79383134f4a2697d5c1c06a20423f"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "3ba6d28ccac1d7c32ed65c7557f8980c"
server_key_iv: "f6450636c53b4d113c86a514c88ff2f6"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:00.858410 15343 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260810 14:33:00.884238 15361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:00.886075 15343 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:33:00.886268 15343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "58e79383134f4a2697d5c1c06a20423f"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "3ba6d28ccac1d7c32ed65c7557f8980c"
server_key_iv: "f6450636c53b4d113c86a514c88ff2f6"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:00.886436 15343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:00.913072 15343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:00.917177 15343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:00.917405 15343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:00.918174 15343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:00.919407 15343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:00.919482 15343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:00.919541 15343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:00.919571 15343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:00.932459 15343 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:40243
I20260810 14:33:00.933693 15343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:33:00.934975 15493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:40243 every 8 connection(s)
I20260810 14:33:00.939304 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 15343
I20260810 14:33:00.939448 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:33:00.939741 1849 external_mini_cluster.cc:1428] Setting key 118cf8a6e0ebfde904fc765f7dd2b226
Aug 10 14:33:00 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:00.958916 15497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:00.936780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46139 (local address 127.1.206.66:40877)
0810 14:33:00.937511 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:00.937573 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:00.938740 (+ 1167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:00.939477 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:00.939487 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:00.939949 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:00.940988 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:00.941009 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.942187 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.942190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:00.943754 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:00.943767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.944705 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.944710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:00.944945 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:00.945750 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:00.945772 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:00.952346 (+ 6574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:00.955007 (+ 2661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:00.955017 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:00.955040 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:00.955505 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:00.955884 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:00.955887 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:00.955889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:00.956107 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:00.956700 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:00.956709 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:00.957095 (+ 386us) client_negotiation.cc:769] Sending connection context
0810 14:33:00.957311 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 14:33:00.957716 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":254,"threads_started":1}
I20260810 14:33:00.959792 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:00.936215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:40877 (local address 127.1.206.126:46139)
0810 14:33:00.936404 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:00.936409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:00.937689 (+ 1280us) server_negotiation.cc:407] Connection header received
0810 14:33:00.939059 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:00.939066 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:00.939141 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:00.939254 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:00.941175 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.942003 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.943957 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:00.944297 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:00.944401 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:00.952639 (+ 8238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:00.952644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:00.952647 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:00.952684 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:00.954788 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:00.955651 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:00.955655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:00.955657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:00.955759 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:00.956245 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:00.956249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:00.956273 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:00.956535 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:00.956636 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:00.959435 (+ 2799us) server_negotiation.cc:299] Negotiation successful
0810 14:33:00.959607 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260810 14:33:00.961779 15495 heartbeater.cc:347] Connected to a master server at 127.1.206.126:46139
I20260810 14:33:00.962028 15495 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:00.962752 15495 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:00.964177 15075 ts_manager.cc:194] Registered new tserver with Master: 58e79383134f4a2697d5c1c06a20423f (127.1.206.66:40243)
I20260810 14:33:00.965029 15075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:40877
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:33:00.996802 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:46139
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372380, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
W20260810 14:33:01.170455 15500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:01.171070 15500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:01.171164 15500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:01.177676 15500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:01.177774 15500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:01.177867 15500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:33:01.186600 15500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.206.84:48095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:46139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:01.188184 15500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:01.189742 15500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:01.203325 15506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:01.203490 15507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:01.203987 15509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:01.204561 15500 server_base.cc:1034] running on GCE node
I20260810 14:33:01.205063 15500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:01.205895 15500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:01.207134 15500 hybrid_clock.cc:648] HybridClock initialized: now 1786372381207105 us; error 47 us; skew 500 ppm
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:01.210933 15500 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:33:01.212131 15500 webserver.cc:460] Webserver started at http://127.1.206.67:35925/ using document root <none> and password file <none>
I20260810 14:33:01.212920 15500 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:01.213020 15500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:01.213323 15500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:01.248237 15500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "a5ae7a9d40e2477da355fcec3b6686dd"
format_stamp: "Formatted at 2026-08-10 14:33:01 on dist-test-slave-0b58"
server_key: "4313158ee507266b2f05e0e0c6d9cfca"
server_key_iv: "319ec5e0461a1e64c78fb54950a1abb9"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:01.249117 15500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "a5ae7a9d40e2477da355fcec3b6686dd"
format_stamp: "Formatted at 2026-08-10 14:33:01 on dist-test-slave-0b58"
server_key: "4313158ee507266b2f05e0e0c6d9cfca"
server_key_iv: "319ec5e0461a1e64c78fb54950a1abb9"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:01.254717 15500 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260810 14:33:01.276824 15517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:01.278717 15500 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.001s
I20260810 14:33:01.278873 15500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "a5ae7a9d40e2477da355fcec3b6686dd"
format_stamp: "Formatted at 2026-08-10 14:33:01 on dist-test-slave-0b58"
server_key: "4313158ee507266b2f05e0e0c6d9cfca"
server_key_iv: "319ec5e0461a1e64c78fb54950a1abb9"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:01.279016 15500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:01.300690 15500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:01.304903 15500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:01.305166 15500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:01.305902 15500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:01.307013 15500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:01.307106 15500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:01.307196 15500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:01.307248 15500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:01.317571 15500 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:45385
I20260810 14:33:01.318830 15500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:33:01.324834 15656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:45385 every 8 connection(s)
I20260810 14:33:01.328375 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 15500
I20260810 14:33:01.328522 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:33:01.328897 1849 external_mini_cluster.cc:1428] Setting key 69393fa4cf2d0c41052fcacaecf3e5e0
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:01.348090 15339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:01.328475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:58837 (local address 127.1.206.126:46139)
0810 14:33:01.328606 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:01.328611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:01.331815 (+ 3204us) server_negotiation.cc:407] Connection header received
0810 14:33:01.333165 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:01.333169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:01.333227 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:01.333278 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:01.335071 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.335864 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.337661 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.337987 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.338062 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:01.341343 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:01.341347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:01.341350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:01.341400 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:01.345275 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:01.346061 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:01.346065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:01.346067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:01.346189 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:01.346660 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:01.346664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:01.346666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:01.346911 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:01.346998 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:01.347767 (+ 769us) server_negotiation.cc:299] Negotiation successful
0810 14:33:01.347914 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:33:01.350159 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:01.327557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46139 (local address 127.1.206.67:58837)
0810 14:33:01.331640 (+ 4083us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:01.331714 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:01.332894 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:01.333755 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:01.333766 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:01.334165 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:01.334886 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:01.334906 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.336035 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.336038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:01.337495 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:01.337507 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.338285 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.338289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:01.338504 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:01.339273 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:01.339295 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:01.341112 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:01.345456 (+ 4344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:01.345463 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:01.345485 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:01.345927 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:01.346314 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:01.346317 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:01.346319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:01.346529 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:01.347072 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:01.347080 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:01.347443 (+ 363us) client_negotiation.cc:769] Sending connection context
0810 14:33:01.348605 (+ 1162us) client_negotiation.cc:240] Negotiation successful
0810 14:33:01.349004 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3802,"thread_start_us":201,"threads_started":1}
I20260810 14:33:01.351883 15657 heartbeater.cc:347] Connected to a master server at 127.1.206.126:46139
I20260810 14:33:01.352154 15657 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:01.352818 15657 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:01.354708 15075 ts_manager.cc:194] Registered new tserver with Master: a5ae7a9d40e2477da355fcec3b6686dd (127.1.206.67:45385)
I20260810 14:33:01.355480 15075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:58837
I20260810 14:33:01.359145 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:33:01.360049 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 15170
I20260810 14:33:01.377501 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 15343
I20260810 14:33:01.414433 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 15500
I20260810 14:33:01.425128 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 15040
I20260810 14:33:01.437026 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:46139
--webserver_interface=127.1.206.126
--webserver_port=38907
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:46139
--ranger_config_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:01.558749 15661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:01.559065 15661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:01.559108 15661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:01.563891 15661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:01.564073 15661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:01.564112 15661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:01.564143 15661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:01.564173 15661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:01.570744 15661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:46139
--ranger_config_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:46139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=38907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:01.572006 15661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:01.573248 15661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:01.582861 15668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:01.582852 15670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:01.582852 15667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:01.583128 15661 server_base.cc:1034] running on GCE node
I20260810 14:33:01.583953 15661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:01.585374 15661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:01.586746 15661 hybrid_clock.cc:648] HybridClock initialized: now 1786372381586711 us; error 68 us; skew 500 ppm
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:01.589916 15661 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:01.590981 15661 webserver.cc:460] Webserver started at http://127.1.206.126:38907/ using document root <none> and password file <none>
I20260810 14:33:01.591594 15661 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:01.591708 15661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:01.646507 15661 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:01.649194 15678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:01.650961 15661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:01.651131 15661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "811c6d6a84b342aea20a63a8e32dcb5b"
format_stamp: "Formatted at 2026-08-10 14:32:59 on dist-test-slave-0b58"
server_key: "f4a8d8696a354e6699a0bf1722ac22fa"
server_key_iv: "123940c138e6678f46455a8eb56d2d42"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:01.651914 15661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:01.669394 15661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:01.672606 15661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:01.672780 15661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:01.680219 15661 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:46139
I20260810 14:33:01.680327 15737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:46139 every 8 connection(s)
I20260810 14:33:01.681414 15661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:01.685985 15738 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:33:01.686571 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 15661
I20260810 14:33:01.687104 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:35357
--local_ip_for_outbound_sockets=127.1.206.65
--tserver_master_addrs=127.1.206.126:46139
--webserver_port=40361
--webserver_interface=127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:01.688454 15738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Bootstrap starting.
I20260810 14:33:01.705752 15738 log.cc:824] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:01.712886 15738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:33:01.713372 15738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Bootstrap complete.
I20260810 14:33:01.717718 15738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:33:01.718152 15738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811c6d6a84b342aea20a63a8e32dcb5b, State: Initialized, Role: FOLLOWER
I20260810 14:33:01.718743 15738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:33:01.718876 15738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:33:01.718966 15738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:33:01.719074 15738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:33:01.721289 15738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:33:01.721664 15738 leader_election.cc:302] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 811c6d6a84b342aea20a63a8e32dcb5b; no voters:
I20260810 14:33:01.722054 15738 leader_election.cc:288] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:33:01.722203 15742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:33:01.722481 15742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [term 2 LEADER]: Becoming Leader. State: Replica: 811c6d6a84b342aea20a63a8e32dcb5b, State: Running, Role: LEADER
I20260810 14:33:01.722836 15742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } }
I20260810 14:33:01.723453 15738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:01.724488 15743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } } }
I20260810 14:33:01.724633 15743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:01.725358 15744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 811c6d6a84b342aea20a63a8e32dcb5b. Latest consensus state: current_term: 2 leader_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811c6d6a84b342aea20a63a8e32dcb5b" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46139 } } }
I20260810 14:33:01.725466 15744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:01.725744 15752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:01.726051 15738 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 14:33:01.732857 15752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:01.733824 15752 catalog_manager.cc:1259] Loaded cluster ID: c4a0e8d82c57436a902690299528c209
I20260810 14:33:01.733898 15752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:33:01.737520 15752 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:33:01.738391 15752 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Loaded TSK: 0
I20260810 14:33:01.739713 15752 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:33:01.825614 15740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:01.826018 15740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:01.826112 15740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:01.832557 15740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:01.832655 15740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:01.832748 15740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:33:01.841014 15740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:35357
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=40361
--tserver_master_addrs=127.1.206.126:46139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:01.842480 15740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:01.843827 15740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:01.856477 15783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:01.856719 15781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:01.856796 15779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:01.857285 15740 server_base.cc:1034] running on GCE node
I20260810 14:33:01.857893 15740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:01.858889 15740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:01.860106 15740 hybrid_clock.cc:648] HybridClock initialized: now 1786372381860081 us; error 50 us; skew 500 ppm
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:01.864112 15740 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:33:01.865556 15740 webserver.cc:460] Webserver started at http://127.1.206.65:40361/ using document root <none> and password file <none>
I20260810 14:33:01.866421 15740 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:01.866578 15740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:01.889726 15740 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 14:33:01.896526 15792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:01.901700 15740 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.001s
I20260810 14:33:01.901932 15740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "29192b9b9e0b4f52ac2467edf3f89a02"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "aaeb9100237291337fb08c28f51c2d7d"
server_key_iv: "08c41e2a0d31f75466e0f1725a64304b"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:01.902835 15740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:01.935034 15740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:01.939105 15740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:01.939400 15740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:01.940287 15740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:01.941593 15740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:01.941731 15740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 14:33:01.941872 15740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:01.941962 15740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:01.954702 15740 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:35357
I20260810 14:33:01.956173 15740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:33:01.956996 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 15740
I20260810 14:33:01.957398 15912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:35357 every 8 connection(s)
I20260810 14:33:01.957531 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:40243
--local_ip_for_outbound_sockets=127.1.206.66
--tserver_master_addrs=127.1.206.126:46139
--webserver_port=38661
--webserver_interface=127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:33:01 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372381, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:01.986564 15916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:01.959868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46139 (local address 127.1.206.65:34389)
0810 14:33:01.964029 (+ 4161us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:01.964111 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:01.965329 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:01.967039 (+ 1710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:01.967047 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:01.967428 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:01.968043 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:01.968059 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.970299 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.970307 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:01.971780 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:01.971793 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.973201 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.973205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:01.973425 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:01.977090 (+ 3665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:01.977118 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:01.979215 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:01.982577 (+ 3362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:01.982585 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:01.982602 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:01.983041 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:01.983505 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:01.983508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:01.983510 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:01.983705 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:01.984583 (+ 878us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:01.984590 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:01.984913 (+ 323us) client_negotiation.cc:769] Sending connection context
0810 14:33:01.985122 (+ 209us) client_negotiation.cc:240] Negotiation successful
0810 14:33:01.985476 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3873,"thread_start_us":173,"threads_started":1}
I20260810 14:33:01.988518 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:01.961551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:34389 (local address 127.1.206.126:46139)
0810 14:33:01.965908 (+ 4357us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:01.965927 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:01.965967 (+ 40us) server_negotiation.cc:407] Connection header received
0810 14:33:01.966248 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:01.966259 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:01.966596 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:01.966961 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:01.968283 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.970063 (+ 1780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.971954 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:01.972764 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:01.972938 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:01.979580 (+ 6642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:01.979591 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:01.979631 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:01.979681 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:01.982387 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:01.983210 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:01.983218 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:01.983224 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:01.983394 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:01.983814 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:01.983819 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:01.983822 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:01.984391 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:01.984515 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:01.987156 (+ 2641us) server_negotiation.cc:299] Negotiation successful
0810 14:33:01.987505 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4187,"thread_start_us":137,"threads_started":1}
I20260810 14:33:01.991991 15913 heartbeater.cc:347] Connected to a master server at 127.1.206.126:46139
I20260810 14:33:01.992278 15913 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:01.992892 15913 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
W20260810 14:33:01.999001 15913 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:46139 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 14:33:01.999159 15913 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:01.999375 15913 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:02.000567 15913 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:02.000810 15913 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
W20260810 14:33:02.001765 15913 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:33:02.114795 15915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:02.115123 15915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:02.115203 15915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:02.119728 15915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:02.119814 15915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:02.119925 15915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:33:02.126422 15915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:40243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=38661
--tserver_master_addrs=127.1.206.126:46139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:02.127557 15915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:02.128698 15915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:02.140089 15927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:02.140225 15924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:02.140080 15923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:02.140506 15915 server_base.cc:1034] running on GCE node
I20260810 14:33:02.141022 15915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:02.141793 15915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:02.142968 15915 hybrid_clock.cc:648] HybridClock initialized: now 1786372382142935 us; error 44 us; skew 500 ppm
Aug 10 14:33:02 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:02.146194 15915 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:33:02.147292 15915 webserver.cc:460] Webserver started at http://127.1.206.66:38661/ using document root <none> and password file <none>
I20260810 14:33:02.147883 15915 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:02.147964 15915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:33:02 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:02.178205 15915 fs_manager.cc:709] Time spent opening directory manager: real 0.013s user 0.002s sys 0.001s
I20260810 14:33:02.181972 15936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:02.183956 15915 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:33:02.184223 15915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "58e79383134f4a2697d5c1c06a20423f"
format_stamp: "Formatted at 2026-08-10 14:33:00 on dist-test-slave-0b58"
server_key: "3ba6d28ccac1d7c32ed65c7557f8980c"
server_key_iv: "f6450636c53b4d113c86a514c88ff2f6"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:02.185088 15915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:02.204478 15915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:02.208833 15915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:02.209128 15915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:02.209960 15915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:02.211007 15915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:02.211063 15915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:02.211114 15915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:02.211135 15915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:02.242633 15915 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:40243
I20260810 14:33:02.243978 15915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:33:02.252204 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 15915
I20260810 14:33:02.252806 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.206.84:48095/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:45385
--local_ip_for_outbound_sockets=127.1.206.67
--tserver_master_addrs=127.1.206.126:46139
--webserver_port=35925
--webserver_interface=127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:02.258934 16069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:40243 every 8 connection(s)
Aug 10 14:33:02 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:02.274463 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:02.248379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:43953 (local address 127.1.206.126:46139)
0810 14:33:02.248519 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:02.248523 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:02.256988 (+ 8465us) server_negotiation.cc:407] Connection header received
0810 14:33:02.258694 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:02.258706 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:02.258779 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:02.258862 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:02.262246 (+ 3384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.263196 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.265501 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.266000 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.266163 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:02.269957 (+ 3794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:02.269961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:02.269964 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:02.269998 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:02.271824 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:02.272560 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:02.272564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:02.272566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:02.272656 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:02.273089 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:02.273092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:02.273094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:02.273321 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:02.273401 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:02.274108 (+ 707us) server_negotiation.cc:299] Negotiation successful
0810 14:33:02.274270 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:33:02.276196 16072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:02.246760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46139 (local address 127.1.206.66:43953)
0810 14:33:02.256759 (+ 9999us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:02.256847 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:02.258362 (+ 1515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:02.260643 (+ 2281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:02.260657 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:02.261131 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:02.261976 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:02.262004 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.263415 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.263421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:02.265269 (+ 1848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:02.265287 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.266453 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.266458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:02.266740 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:02.267576 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:02.267607 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:02.269705 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:02.271976 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:02.271984 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:02.272012 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:02.272431 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:02.272797 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:02.272800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:02.272802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:02.272987 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:02.273466 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:02.273473 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:02.273823 (+ 350us) client_negotiation.cc:769] Sending connection context
0810 14:33:02.274670 (+ 847us) client_negotiation.cc:240] Negotiation successful
0810 14:33:02.275054 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9642,"thread_start_us":160,"threads_started":1}
I20260810 14:33:02.277762 16070 heartbeater.cc:347] Connected to a master server at 127.1.206.126:46139
I20260810 14:33:02.278023 16070 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:02.278565 16070 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
W20260810 14:33:02.280246 16070 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:46139 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 14:33:02.280429 16070 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:02.280642 16070 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:02.281538 16070 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:02.281711 16070 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
W20260810 14:33:02.282521 16070 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:33:02.407994 16073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:02.408464 16073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:02.408542 16073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:02.414866 16073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:02.414970 16073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:02.415059 16073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:33:02.422405 16073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.206.84:48095/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:45385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=35925
--tserver_master_addrs=127.1.206.126:46139
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:02.423925 16073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:02.425379 16073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:02.438572 16082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:02.438814 16084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:02.438611 16079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:02.439603 16073 server_base.cc:1034] running on GCE node
I20260810 14:33:02.440167 16073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:02.441100 16073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:02.442315 16073 hybrid_clock.cc:648] HybridClock initialized: now 1786372382442267 us; error 53 us; skew 500 ppm
Aug 10 14:33:02 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:02.445484 16073 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:33:02.446507 16073 webserver.cc:460] Webserver started at http://127.1.206.67:35925/ using document root <none> and password file <none>
I20260810 14:33:02.447157 16073 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:02.447242 16073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:33:02 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:02.469645 16073 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:33:02.474858 16093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:02.476487 16073 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260810 14:33:02.476634 16073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "a5ae7a9d40e2477da355fcec3b6686dd"
format_stamp: "Formatted at 2026-08-10 14:33:01 on dist-test-slave-0b58"
server_key: "4313158ee507266b2f05e0e0c6d9cfca"
server_key_iv: "319ec5e0461a1e64c78fb54950a1abb9"
server_key_version: "kuduclusterkey@0"
I20260810 14:33:02.477255 16073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:02.507004 16073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:02.511308 16073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:02.511538 16073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:02.512490 16073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:02.513734 16073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:02.513813 16073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:02.513882 16073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:02.513917 16073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:02.528405 16073 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:45385
I20260810 14:33:02.529600 16073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:33:02.530541 16220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:45385 every 8 connection(s)
I20260810 14:33:02.534797 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 16073
Aug 10 14:33:02 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:02.546784 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:02.532159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46139 (local address 127.1.206.67:42531)
0810 14:33:02.532710 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:02.532768 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:02.533649 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:02.534252 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:02.534262 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:02.534576 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:02.535180 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:02.535197 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.536468 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.536472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:02.537968 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:02.537981 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.538675 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.538678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:02.538846 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:02.539535 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:02.539552 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:02.541168 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:02.543113 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:02.543120 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:02.543140 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:02.543571 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:02.543937 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:02.543942 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:02.543944 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:02.544166 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:02.544739 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:02.544761 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:02.545146 (+ 385us) client_negotiation.cc:769] Sending connection context
0810 14:33:02.545362 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 14:33:02.545642 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":154,"threads_started":1}
I20260810 14:33:02.547657 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:02.531708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:42531 (local address 127.1.206.126:46139)
0810 14:33:02.531888 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:02.531893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:02.532899 (+ 1006us) server_negotiation.cc:407] Connection header received
0810 14:33:02.533876 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:02.533880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:02.533938 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:02.534065 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:02.535623 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.536316 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.538104 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.538438 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.538528 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:02.541355 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:02.541359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:02.541362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:02.541396 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:02.542977 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:02.543698 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:02.543701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:02.543703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:02.543818 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:02.544325 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:02.544328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:02.544330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:02.544592 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:02.547291 (+ 2699us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:02.547372 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 14:33:02.547499 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 14:33:02.549317 16221 heartbeater.cc:347] Connected to a master server at 127.1.206.126:46139
I20260810 14:33:02.549599 16221 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:02.550216 16221 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:02.550894 16225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:02.535576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53966 (local address 127.1.206.126:46139)
0810 14:33:02.536795 (+ 1219us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:02.536798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:02.536808 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:33:02.536839 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:02.536841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:02.536875 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:02.536976 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:02.537726 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.538371 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.539671 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:02.540022 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:02.540153 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:02.543215 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:02.543219 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:02.543222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:02.543257 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:02.545171 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:02.545709 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:02.545712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:02.545714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:02.545796 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:02.546155 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:02.546159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:02.546160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:02.546368 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:02.546574 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:02.549039 (+ 2465us) server_negotiation.cc:299] Negotiation successful
0810 14:33:02.549169 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1153,"thread_start_us":93,"threads_started":1}
W20260810 14:33:02.552186 16221 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:46139 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 14:33:02.552368 16221 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:02.552569 16221 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:02.553689 16221 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:02.553902 16221 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
W20260810 14:33:02.554730 16221 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 14:33:02 dist-test-slave-0b58 krb5kdc[14527](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:03.001982 15913 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:03.002295 15913 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:03.003371 15698 ts_manager.cc:194] Registered new tserver with Master: 29192b9b9e0b4f52ac2467edf3f89a02 (127.1.206.65:35357)
I20260810 14:33:03.004702 15698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:34389
I20260810 14:33:03.282797 16070 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:03.283149 16070 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:03.284161 15698 ts_manager.cc:194] Registered new tserver with Master: 58e79383134f4a2697d5c1c06a20423f (127.1.206.66:40243)
I20260810 14:33:03.284967 15698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:43953
Aug 10 14:33:03 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:03.555007 16221 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:03.555341 16221 heartbeater.cc:511] Master 127.1.206.126:46139 requested a full tablet report, sending...
I20260810 14:33:03.556360 15698 ts_manager.cc:194] Registered new tserver with Master: a5ae7a9d40e2477da355fcec3b6686dd (127.1.206.67:45385)
I20260810 14:33:03.557144 15698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:42531
I20260810 14:33:03.562610 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:33:03.580560 16247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.564473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53970 (local address 127.1.206.126:46139)
0810 14:33:03.568546 (+ 4073us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:03.568552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:03.568577 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:33:03.568640 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:03.568644 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:03.568711 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:03.569950 (+ 1239us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:03.570080 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.570925 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.572183 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.572573 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.573369 (+ 796us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.576107 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:03.576111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:03.576113 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:03.576152 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:03.578356 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:03.579028 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:03.579034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:03.579036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:03.579138 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:03.579525 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:03.579527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:03.579528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:03.579739 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:03.579884 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:03.580163 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 14:33:03.580338 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3929,"thread_start_us":95,"threads_started":1}
Aug 10 14:33:03 dist-test-slave-0b58 krb5kdc[14527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372382, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for HTTP/127.1.206.84@KRBTEST.COM
I20260810 14:33:03.585656 15698 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:33:03.599895 15698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:33:03.641376 16256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.627426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:45385 (local address 127.0.0.1:36526)
0810 14:33:03.628738 (+ 1312us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:03.628750 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:03.628815 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:03.632604 (+ 3789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:03.632612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:03.632646 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:03.632818 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.632827 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.636472 (+ 3645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.636477 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.639285 (+ 2808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.639297 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.640736 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.640740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.640876 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.640918 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 14:33:03.641037 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 14:33:03.641198 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1264,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260810 14:33:03.642206 16262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.627592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.1.206.67:45385)
0810 14:33:03.629503 (+ 1911us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:03.629510 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:03.631911 (+ 2401us) server_negotiation.cc:407] Connection header received
0810 14:33:03.632031 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:03.632038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:03.632378 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:03.632574 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:03.632990 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.636319 (+ 3329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.639458 (+ 3139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.640387 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.640505 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.640672 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:03.641907 (+ 1235us) server_negotiation.cc:299] Negotiation successful
0810 14:33:03.642043 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1799,"thread_start_us":95,"threads_started":1}
I20260810 14:33:03.644554 16261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.626162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:40243 (local address 127.0.0.1:34284)
0810 14:33:03.628022 (+ 1860us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:03.628096 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:03.628234 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:03.637874 (+ 9640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:03.637878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:03.637905 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:03.638025 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.638033 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.639749 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.639753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.641936 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.641947 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.644100 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.644104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.644202 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.644230 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:33:03.644311 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 14:33:03.644396 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1665,"mutex_wait_us":1032,"thread_start_us":161,"threads_started":1}
I20260810 14:33:03.645839 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.627093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:35357 (local address 127.0.0.1:42324)
0810 14:33:03.628503 (+ 1410us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:03.628515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:03.628589 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:03.634138 (+ 5549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:03.634142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:03.634167 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:03.634286 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.634295 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.641761 (+ 7466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.641766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.642950 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.642963 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.645447 (+ 2484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.645452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.645553 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.645578 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 14:33:03.645634 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 14:33:03.645719 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1347,"thread_start_us":110,"threads_started":1}
I20260810 14:33:03.645732 16146 tablet_service.cc:1467] Processing CreateTablet for tablet 28f186a424234ed587d1300235482511 (DEFAULT_TABLE table=test-table [id=f20be6182ff344448385c08f42734b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:03.645675 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.626637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34284 (local address 127.1.206.66:40243)
0810 14:33:03.637326 (+ 10689us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:03.637335 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:03.637364 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:33:03.637450 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:03.637456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:03.637692 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:03.637869 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:03.638177 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.639604 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.642100 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.643946 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.644980 (+ 1034us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.645146 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:03.645210 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 14:33:03.645318 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10542,"thread_start_us":80,"threads_started":1}
I20260810 14:33:03.648295 16146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f186a424234ed587d1300235482511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:03.647778 16260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.627252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42324 (local address 127.1.206.65:35357)
0810 14:33:03.632556 (+ 5304us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:03.632564 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:03.632592 (+ 28us) server_negotiation.cc:407] Connection header received
0810 14:33:03.632672 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:03.632677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:03.632896 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:03.634490 (+ 1594us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:03.634653 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.635838 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.643139 (+ 7301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.645299 (+ 2160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.647244 (+ 1945us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.647434 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:03.647500 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 14:33:03.647605 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5165,"thread_start_us":123,"threads_started":1}
I20260810 14:33:03.650108 15990 tablet_service.cc:1467] Processing CreateTablet for tablet 28f186a424234ed587d1300235482511 (DEFAULT_TABLE table=test-table [id=f20be6182ff344448385c08f42734b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:03.651101 15990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f186a424234ed587d1300235482511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:03.652048 15822 tablet_service.cc:1467] Processing CreateTablet for tablet 28f186a424234ed587d1300235482511 (DEFAULT_TABLE table=test-table [id=f20be6182ff344448385c08f42734b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:03.653285 15822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28f186a424234ed587d1300235482511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:03.664536 16266 tablet_bootstrap.cc:492] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Bootstrap starting.
I20260810 14:33:03.667831 16266 tablet_bootstrap.cc:654] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:03.669030 16266 log.cc:824] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:03.672832 16263 tablet_bootstrap.cc:492] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02: Bootstrap starting.
I20260810 14:33:03.675829 16265 tablet_bootstrap.cc:492] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: Bootstrap starting.
I20260810 14:33:03.675882 16263 tablet_bootstrap.cc:654] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:03.676873 16263 log.cc:824] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:03.678578 16265 tablet_bootstrap.cc:654] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:03.679582 16265 log.cc:824] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:03.690654 16263 tablet_bootstrap.cc:492] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02: No bootstrap required, opened a new log
I20260810 14:33:03.691005 16263 ts_tablet_manager.cc:1397] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260810 14:33:03.695717 16263 raft_consensus.cc:348] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.696368 16263 raft_consensus.cc:374] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:03.696520 16263 raft_consensus.cc:729] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29192b9b9e0b4f52ac2467edf3f89a02, State: Initialized, Role: FOLLOWER
I20260810 14:33:03.697201 16263 consensus_queue.cc:260] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.698072 15913 heartbeater.cc:503] Master 127.1.206.126:46139 was elected leader, sending a full tablet report...
I20260810 14:33:03.698601 16263 ts_tablet_manager.cc:1428] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 14:33:03.703085 16266 tablet_bootstrap.cc:492] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: No bootstrap required, opened a new log
I20260810 14:33:03.703361 16266 ts_tablet_manager.cc:1397] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.000s
I20260810 14:33:03.707602 16266 raft_consensus.cc:348] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.708022 16266 raft_consensus.cc:374] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:03.708119 16266 raft_consensus.cc:729] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5ae7a9d40e2477da355fcec3b6686dd, State: Initialized, Role: FOLLOWER
W20260810 14:33:03.708679 15914 tablet.cc:2369] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:03.709564 16266 consensus_queue.cc:260] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.710940 16266 ts_tablet_manager.cc:1428] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260810 14:33:03.711364 16221 heartbeater.cc:503] Master 127.1.206.126:46139 was elected leader, sending a full tablet report...
I20260810 14:33:03.720942 16271 raft_consensus.cc:482] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:03.721267 16271 raft_consensus.cc:504] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.724049 16271 leader_election.cc:288] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58e79383134f4a2697d5c1c06a20423f (127.1.206.66:40243), 29192b9b9e0b4f52ac2467edf3f89a02 (127.1.206.65:35357)
I20260810 14:33:03.726558 16265 tablet_bootstrap.cc:492] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: No bootstrap required, opened a new log
I20260810 14:33:03.726804 16265 ts_tablet_manager.cc:1397] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: Time spent bootstrapping tablet: real 0.051s user 0.007s sys 0.000s
I20260810 14:33:03.731290 16265 raft_consensus.cc:348] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.731725 16265 raft_consensus.cc:374] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:03.731841 16265 raft_consensus.cc:729] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e79383134f4a2697d5c1c06a20423f, State: Initialized, Role: FOLLOWER
I20260810 14:33:03.732488 16265 consensus_queue.cc:260] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.733798 16265 ts_tablet_manager.cc:1428] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 14:33:03.734262 16070 heartbeater.cc:503] Master 127.1.206.126:46139 was elected leader, sending a full tablet report...
I20260810 14:33:03.737911 16258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.723430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44581 (local address 127.1.206.66:40243)
0810 14:33:03.723587 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:03.723592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:03.732449 (+ 8857us) server_negotiation.cc:407] Connection header received
0810 14:33:03.732677 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:03.732680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:03.732731 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:03.732796 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:03.733278 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.734002 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.736444 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.737092 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.737211 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.737274 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:03.737686 (+ 412us) server_negotiation.cc:299] Negotiation successful
0810 14:33:03.737785 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:33:03.739501 16272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.722904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:40243 (local address 127.1.206.67:44581)
0810 14:33:03.732346 (+ 9442us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:03.732368 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:03.732540 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:03.732972 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:03.732974 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:03.732995 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:03.733148 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.733154 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.734170 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.734173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.735462 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.735475 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.737384 (+ 1909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.737390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.737520 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.737544 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 14:33:03.738278 (+ 734us) client_negotiation.cc:240] Negotiation successful
0810 14:33:03.739330 (+ 1052us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9326,"thread_start_us":132,"threads_started":1}
I20260810 14:33:03.740442 16012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f186a424234ed587d1300235482511" candidate_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e79383134f4a2697d5c1c06a20423f" is_pre_election: true
I20260810 14:33:03.740775 16012 raft_consensus.cc:2454] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5ae7a9d40e2477da355fcec3b6686dd in term 0.
I20260810 14:33:03.741330 16095 leader_election.cc:302] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e79383134f4a2697d5c1c06a20423f, a5ae7a9d40e2477da355fcec3b6686dd; no voters:
I20260810 14:33:03.741864 16271 raft_consensus.cc:2781] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:33:03.741957 16271 raft_consensus.cc:482] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:33:03.741997 16271 raft_consensus.cc:3037] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:03.743341 16271 raft_consensus.cc:504] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.743724 16271 leader_election.cc:288] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [CANDIDATE]: Term 1 election: Requested vote from peers 58e79383134f4a2697d5c1c06a20423f (127.1.206.66:40243), 29192b9b9e0b4f52ac2467edf3f89a02 (127.1.206.65:35357)
I20260810 14:33:03.744434 16012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f186a424234ed587d1300235482511" candidate_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e79383134f4a2697d5c1c06a20423f"
I20260810 14:33:03.744563 16012 raft_consensus.cc:3037] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:03.745901 16012 raft_consensus.cc:2454] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5ae7a9d40e2477da355fcec3b6686dd in term 1.
I20260810 14:33:03.746347 16095 leader_election.cc:302] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e79383134f4a2697d5c1c06a20423f, a5ae7a9d40e2477da355fcec3b6686dd; no voters:
I20260810 14:33:03.746598 16271 raft_consensus.cc:2781] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:03.746888 16271 raft_consensus.cc:686] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 1 LEADER]: Becoming Leader. State: Replica: a5ae7a9d40e2477da355fcec3b6686dd, State: Running, Role: LEADER
I20260810 14:33:03.747323 16271 consensus_queue.cc:237] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } }
I20260810 14:33:03.750054 16260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.723951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:56901 (local address 127.1.206.65:35357)
0810 14:33:03.724089 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:03.724094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:03.735688 (+ 11594us) server_negotiation.cc:407] Connection header received
0810 14:33:03.735799 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:03.735803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:03.735863 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:03.735950 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:03.736427 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.737153 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.748407 (+ 11254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.749113 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.749266 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.749328 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:03.749811 (+ 483us) server_negotiation.cc:299] Negotiation successful
0810 14:33:03.749916 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 14:33:03.750649 16273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.723820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:35357 (local address 127.1.206.67:56901)
0810 14:33:03.735583 (+ 11763us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:03.735602 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:03.735709 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:03.736072 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:03.736075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:03.736096 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:03.736243 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.736251 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.737314 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.737317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.738421 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:03.738433 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.749464 (+ 11031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.749468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:03.749623 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.749651 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:33:03.750409 (+ 758us) client_negotiation.cc:240] Negotiation successful
0810 14:33:03.750507 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11680,"thread_start_us":100,"threads_started":1}
I20260810 14:33:03.750886 15698 catalog_manager.cc:5495] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd reported cstate change: term changed from 0 to 1, leader changed from <none> to a5ae7a9d40e2477da355fcec3b6686dd (127.1.206.67). New cstate: current_term: 1 leader_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 45385 } health_report { overall_health: HEALTHY } } }
I20260810 14:33:03.752738 15864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f186a424234ed587d1300235482511" candidate_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" is_pre_election: true
I20260810 14:33:03.753059 15864 raft_consensus.cc:2454] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5ae7a9d40e2477da355fcec3b6686dd in term 0.
I20260810 14:33:03.753953 15864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f186a424234ed587d1300235482511" candidate_uuid: "a5ae7a9d40e2477da355fcec3b6686dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29192b9b9e0b4f52ac2467edf3f89a02"
I20260810 14:33:03.754065 15864 raft_consensus.cc:3037] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:03.755404 15864 raft_consensus.cc:2454] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5ae7a9d40e2477da355fcec3b6686dd in term 1.
W20260810 14:33:03.762951 16071 tablet.cc:2369] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:33:03.781663 16223 tablet.cc:2369] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:03.799199 16262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.793725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36536 (local address 127.1.206.67:45385)
0810 14:33:03.793989 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:03.793994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:03.794008 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:33:03.794101 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:03.794104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:03.794190 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:03.794302 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:33:03.794731 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.795535 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.796869 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:03.797222 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:03.797333 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:03.797805 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:33:03.798437 (+ 632us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:33:03.798567 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:03.798942 (+ 375us) server_negotiation.cc:299] Negotiation successful
0810 14:33:03.799012 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260810 14:33:03.807193 15864 raft_consensus.cc:1261] T 28f186a424234ed587d1300235482511 P 29192b9b9e0b4f52ac2467edf3f89a02 [term 1 FOLLOWER]: Refusing update from remote peer a5ae7a9d40e2477da355fcec3b6686dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:03.808149 16271 consensus_queue.cc:1035] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "29192b9b9e0b4f52ac2467edf3f89a02" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:03.816771 16012 raft_consensus.cc:1261] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 1 FOLLOWER]: Refusing update from remote peer a5ae7a9d40e2477da355fcec3b6686dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:03.817632 16271 consensus_queue.cc:1035] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "58e79383134f4a2697d5c1c06a20423f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 40243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:03.836615 16278 mvcc.cc:205] Tried to move back new op lower bound from 7316981284064030720 to 7316981283832750080. Current Snapshot: MvccSnapshot[applied={T|T < 7316981284064030720}]
I20260810 14:33:03.838828 16281 mvcc.cc:205] Tried to move back new op lower bound from 7316981284064030720 to 7316981283832750080. Current Snapshot: MvccSnapshot[applied={T|T < 7316981284064030720}]
I20260810 14:33:03.843901 16279 mvcc.cc:205] Tried to move back new op lower bound from 7316981284064030720 to 7316981283832750080. Current Snapshot: MvccSnapshot[applied={T|T < 7316981284064030720}]
I20260810 14:33:03.859869 15698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:03.860080 15698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:03.863224 15698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 811c6d6a84b342aea20a63a8e32dcb5b: Sending DeleteTablet for 3 replicas of tablet 28f186a424234ed587d1300235482511
I20260810 14:33:03.864580 16146 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f186a424234ed587d1300235482511 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:03 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:36526
I20260810 14:33:03.864737 15990 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f186a424234ed587d1300235482511 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:03 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:34284
I20260810 14:33:03.864912 15822 tablet_service.cc:1514] Processing DeleteTablet for tablet 28f186a424234ed587d1300235482511 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:03 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:42324
I20260810 14:33:03.865844 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 15740
I20260810 14:33:03.873018 16287 tablet_replica.cc:330] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: stopping tablet replica
I20260810 14:33:03.873518 16287 raft_consensus.cc:2229] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:33:03.880152 16287 raft_consensus.cc:2258] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:03.888787 16288 tablet_replica.cc:330] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: stopping tablet replica
I20260810 14:33:03.890170 16288 raft_consensus.cc:2229] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:03.891151 16288 raft_consensus.cc:2258] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:03.891830 16287 ts_tablet_manager.cc:1905] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:03.895159 16287 ts_tablet_manager.cc:1918] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:03.896375 16288 ts_tablet_manager.cc:1905] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:03.902690 16288 ts_tablet_manager.cc:1918] T 28f186a424234ed587d1300235482511 P 58e79383134f4a2697d5c1c06a20423f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:03.902959 16287 log.cc:1196] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/28f186a424234ed587d1300235482511
W20260810 14:33:03.903498 15681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:35357 (error 108)
I20260810 14:33:03.904784 16287 ts_tablet_manager.cc:1939] T 28f186a424234ed587d1300235482511 P a5ae7a9d40e2477da355fcec3b6686dd: Deleting consensus metadata
I20260810 14:33:03.905063 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 15915
I20260810 14:33:03.909021 15681 catalog_manager.cc:4841] TS a5ae7a9d40e2477da355fcec3b6686dd (127.1.206.67:45385): tablet 28f186a424234ed587d1300235482511 (table test-table [id=f20be6182ff344448385c08f42734b10]) successfully deleted
I20260810 14:33:03.916513 16259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:03.916094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:35357 (local address 127.0.0.1:42336)
0810 14:33:03.916294 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:03.916399 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:35357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260810 14:33:03.916860 15681 catalog_manager.cc:4584] TS 29192b9b9e0b4f52ac2467edf3f89a02 (127.1.206.65:35357): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 28f186a424234ed587d1300235482511: Network error: Client connection negotiation failed: client connection to 127.1.206.65:35357: connect: Connection refused (error 111)
W20260810 14:33:03.924777 16259 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:33:03.924168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:40243 (local address 127.0.0.1:34298)
0810 14:33:03.924349 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:03.924368 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:03.924511 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:03.924638 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.66:40243: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 14:33:03.926851 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 16073
I20260810 14:33:03.935895 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 15661
I20260810 14:33:03.949316 1849 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 14:33:04.295200 1849 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 14:33:04.295359 1849 mini_ranger.cc:66] Stopping Ranger...
I20260810 14:33:04.641027 1849 mini_ranger.cc:68] Stopped Ranger
2026-08-10 14:33:04.641 UTC [14561] LOG: received smart shutdown request
2026-08-10 14:33:04.645 UTC [14561] LOG: background worker "logical replication launcher" (PID 14570) exited with exit code 1
2026-08-10 14:33:04.645 UTC [14565] LOG: shutting down
2026-08-10 14:33:04.826 UTC [14561] LOG: database system is shut down
2026-08-10T14:33:04Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49573 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:33:05 dist-test-slave-0b58 krb5kdc[16301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:33:05 dist-test-slave-0b58 krb5kdc[16301](info): set up 2 sockets
Aug 10 14:33:05 dist-test-slave-0b58 krb5kdc[16301](info): commencing operation
krb5kdc: starting...
W20260810 14:33:06.044245 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:33:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:33:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:33:06.175360 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:46651
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:46651,127.1.206.125:45117,127.1.206.124:45475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:06.294759 16316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:06.295116 16316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:06.295209 16316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:06.299418 16316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:06.299542 16316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:06.299582 16316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:06.299623 16316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:06.299659 16316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:06.305274 16316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:46651,127.1.206.125:45117,127.1.206.124:45475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:46651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:06.306602 16316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:06.307703 16316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:06.316349 16324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:06.316351 16322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:06.316413 16321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:06.316553 16316 server_base.cc:1034] running on GCE node
I20260810 14:33:06.317260 16316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:06.318426 16316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:06.319607 16316 hybrid_clock.cc:648] HybridClock initialized: now 1786372386319587 us; error 32 us; skew 500 ppm
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:06.327651 16316 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:06.328727 16316 webserver.cc:460] Webserver started at http://127.1.206.126:42755/ using document root <none> and password file <none>
I20260810 14:33:06.329291 16316 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:06.329360 16316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:06.329536 16316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:06.331640 16316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "a168ce1399ac411c9dec9b080c5d175f"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "3d6e4baed9e605c6088933e2448d65ed"
server_key_iv: "4cb7bf3222e21c3c53173c8f7ff30884"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.332178 16316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "a168ce1399ac411c9dec9b080c5d175f"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "3d6e4baed9e605c6088933e2448d65ed"
server_key_iv: "4cb7bf3222e21c3c53173c8f7ff30884"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.335973 16316 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:06.338783 16332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:06.340116 16316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:33:06.340327 16316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "a168ce1399ac411c9dec9b080c5d175f"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "3d6e4baed9e605c6088933e2448d65ed"
server_key_iv: "4cb7bf3222e21c3c53173c8f7ff30884"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.340473 16316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:06.354460 16316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:06.357924 16316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:06.358166 16316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:06.366047 16316 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:46651
I20260810 14:33:06.366129 16396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:46651 every 8 connection(s)
I20260810 14:33:06.367172 16316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:06.370294 16397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:06.373245 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 16316
I20260810 14:33:06.373363 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:33:06.373637 1849 external_mini_cluster.cc:1428] Setting key 17446184f3cc2fec22a319c86ea74fc7
I20260810 14:33:06.374593 16397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.206.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.125@KRBTEST.COM" created.
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:06.392431 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.377266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46651 (local address 127.0.0.1:59358)
0810 14:33:06.377838 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.377899 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.378875 (+ 976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.379799 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.379803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.380142 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.380510 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.380526 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.382467 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.382473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.383507 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.383518 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.384326 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.384333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.384432 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.385019 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.385036 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.386866 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.389063 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.389072 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.389085 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.389341 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.389690 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.389695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.389697 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.389830 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.390500 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.390506 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.390667 (+ 161us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.390862 (+ 195us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.391281 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":115,"thread_start_us":165,"threads_started":1}
I20260810 14:33:06.392438 16401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.378226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59358 (local address 127.1.206.126:46651)
0810 14:33:06.378604 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.378617 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.378669 (+ 52us) server_negotiation.cc:407] Connection header received
0810 14:33:06.379232 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.379242 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.379530 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.379768 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.380691 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.382194 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.383634 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.384095 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.384229 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.387039 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.387045 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.387057 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.387080 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.388921 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.389461 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.389468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.389469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.389589 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.389928 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.389933 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.389935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.390374 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.390533 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.390927 (+ 394us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.391227 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":227,"thread_start_us":103,"threads_started":1}
I20260810 14:33:06.395757 16397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:33:06.396807 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.396478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39238)
0810 14:33:06.396634 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.396715 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 14:33:06.397073 16339 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
I20260810 14:33:06.398098 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.397864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39250)
0810 14:33:06.397985 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.398033 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 14:33:06.398270 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:45117: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab.
Entry for principal kudu/127.1.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab.
I20260810 14:33:06.403514 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:45117
--webserver_interface=127.1.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab
--principal=kudu/127.1.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:46651,127.1.206.125:45117,127.1.206.124:45475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:06.447655 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } attempt: 1
I20260810 14:33:06.448796 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.448372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39252)
0810 14:33:06.448632 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.448709 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260810 14:33:06.449676 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.449429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39260)
0810 14:33:06.449552 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.449612 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 14:33:06.449836 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:45117: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
I20260810 14:33:06.518013 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } attempt: 2
I20260810 14:33:06.518869 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.518564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39262)
0810 14:33:06.518713 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.518787 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 14:33:06.519721 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.519414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39274)
0810 14:33:06.519572 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.519642 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260810 14:33:06.519927 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:45117: Network error: Client connection negotiation failed: client connection to 127.1.206.125:45117: connect: Connection refused (error 111)
W20260810 14:33:06.524521 16405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:06.524807 16405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:06.524849 16405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:06.529110 16405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:06.529198 16405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:06.529219 16405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:06.529265 16405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:06.529300 16405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:06.535215 16405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:46651,127.1.206.125:45117,127.1.206.124:45475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab
--principal=kudu/127.1.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:45117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:06.536520 16405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:06.537592 16405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:06.546437 16410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:06.546468 16411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:06.546478 16415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:06.546788 16405 server_base.cc:1034] running on GCE node
I20260810 14:33:06.547446 16405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:06.548678 16405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:06.549846 16405 hybrid_clock.cc:648] HybridClock initialized: now 1786372386549832 us; error 26 us; skew 500 ppm
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:06.552876 16405 init.cc:377] Logged in from keytab as kudu/127.1.206.125@KRBTEST.COM (short username kudu)
I20260810 14:33:06.553900 16405 webserver.cc:460] Webserver started at http://127.1.206.125:39437/ using document root <none> and password file <none>
I20260810 14:33:06.554507 16405 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:06.554574 16405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:06.554849 16405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:06.557168 16405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data/instance:
uuid: "288b526550454c56a2a6e5ce8ed59bda"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "8daafa2a1683d1804ebe880ce3f36178"
server_key_iv: "18ead643ebf7191762becf2d90a2ad82"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.557789 16405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/wal/instance:
uuid: "288b526550454c56a2a6e5ce8ed59bda"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "8daafa2a1683d1804ebe880ce3f36178"
server_key_iv: "18ead643ebf7191762becf2d90a2ad82"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.561925 16405 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:33:06.564939 16422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:06.566394 16405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:06.566546 16405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/wal
uuid: "288b526550454c56a2a6e5ce8ed59bda"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "8daafa2a1683d1804ebe880ce3f36178"
server_key_iv: "18ead643ebf7191762becf2d90a2ad82"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.566752 16405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:06.584740 16405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:06.588382 16405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:06.588627 16405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:06.596870 16405 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.125:45117
I20260810 14:33:06.596885 16478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.125:45117 every 8 connection(s)
I20260810 14:33:06.597970 16405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
I20260810 14:33:06.601040 16479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:06.602036 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 16405
I20260810 14:33:06.602170 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-1/wal/instance
I20260810 14:33:06.602489 1849 external_mini_cluster.cc:1428] Setting key a780d0003ca9fbaa6494a226c9d94b52
I20260810 14:33:06.606612 16479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:33:06.611129 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } attempt: 3
WARNING: no policy specified for kudu/127.1.206.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.124@KRBTEST.COM" created.
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:06.623967 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.611644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39286)
0810 14:33:06.611875 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.611891 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.611985 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.612912 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.612916 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.613088 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.613221 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.613229 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.614788 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.614792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.615512 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.615522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.616550 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.616554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.616668 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.617274 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.617294 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.619095 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.621923 (+ 2828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.621929 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.621932 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.622141 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.622559 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.622562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.622564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.622655 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.623380 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.623383 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.623496 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.623609 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.623780 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260810 14:33:06.624352 16401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.609211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59370 (local address 127.1.206.126:46651)
0810 14:33:06.609365 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.609369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.610685 (+ 1316us) server_negotiation.cc:407] Connection header received
0810 14:33:06.611972 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.611976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.612033 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.612093 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.613963 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.614995 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.616429 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.616851 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.616979 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.619720 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.619725 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.619730 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.619762 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.621369 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.621984 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.621991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.621995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.622102 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.622600 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.622603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.622605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.622877 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.622964 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.623659 (+ 695us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.624195 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":389,"server-negotiator.queue_time_us":57}
I20260810 14:33:06.625275 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.609857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46651 (local address 127.0.0.1:59370)
0810 14:33:06.610507 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.610558 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.611663 (+ 1105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.612515 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.612524 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.613020 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.613697 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.613711 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.615281 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.615288 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.616247 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.616258 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.617018 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.617023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.617204 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.617783 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.617801 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.619560 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.621507 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.621519 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.621533 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.621883 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.622244 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.622249 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.622253 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.622468 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.623080 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.623090 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.623334 (+ 244us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.623760 (+ 426us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.624675 (+ 915us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":614,"spinlock_wait_cycles":1280,"thread_start_us":192,"threads_started":1}
I20260810 14:33:06.625785 16483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.611773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39286 (local address 127.1.206.125:45117)
0810 14:33:06.612246 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.612283 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.612341 (+ 58us) server_negotiation.cc:407] Connection header received
0810 14:33:06.612486 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.612491 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.612709 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.613393 (+ 684us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.613523 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.614638 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.615630 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.616424 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.616599 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.619332 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.619342 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.619360 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.619395 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.621787 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.622313 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.622320 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.622321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.622444 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.622778 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.622782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.622783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.623255 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.623395 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.623712 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.624075 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":371,"thread_start_us":158,"threads_started":1}
I20260810 14:33:06.627007 16479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:33:06.627837 16397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:33:06.628741 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.628457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32938)
0810 14:33:06.628593 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.628657 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 14:33:06.629485 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.629200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32944)
0810 14:33:06.629354 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.629408 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260810 14:33:06.629642 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:45475: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab.
Entry for principal kudu/127.1.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab.
I20260810 14:33:06.635462 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:45475
--webserver_interface=127.1.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab
--principal=kudu/127.1.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:42137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:46651,127.1.206.125:45117,127.1.206.124:45475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:06.636672 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.627659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39288)
0810 14:33:06.627991 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.628019 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.628131 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.628364 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.628367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.628580 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.628702 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.628710 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.629667 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.629671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.630227 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.630235 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.630776 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.630779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.630901 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.631376 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.631387 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.633110 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.635005 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.635011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.635014 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.635210 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.635536 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.635541 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.635543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.635628 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.636040 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.636043 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.636135 (+ 92us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.636244 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.636552 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":106}
I20260810 14:33:06.636672 16483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.627801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39288 (local address 127.1.206.125:45117)
0810 14:33:06.627925 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.627932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.628083 (+ 151us) server_negotiation.cc:407] Connection header received
0810 14:33:06.628218 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.628222 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.628289 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.628357 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.628852 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.629511 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.630368 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.630652 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.630770 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.633264 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.633268 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.633271 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.633326 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.634891 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.635364 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.635366 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.635367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.635441 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.635732 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.635734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.635736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.635934 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.636051 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.636338 (+ 287us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.636489 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":51}
I20260810 14:33:06.637640 16479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:33:06.638468 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.638173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32948)
0810 14:33:06.638300 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.638401 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 14:33:06.639112 16426 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
I20260810 14:33:06.640084 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.639855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32952)
0810 14:33:06.639967 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.640019 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 14:33:06.640300 16479 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:45475: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
I20260810 14:33:06.660802 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } attempt: 1
I20260810 14:33:06.661782 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.661427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32968)
0810 14:33:06.661585 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.661677 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 14:33:06.662596 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.662358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32972)
0810 14:33:06.662485 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.662539 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 14:33:06.662765 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:45475: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
I20260810 14:33:06.689608 16479 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } attempt: 1
I20260810 14:33:06.690685 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.690287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32976)
0810 14:33:06.690497 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.690582 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260810 14:33:06.691753 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.691482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32988)
0810 14:33:06.691631 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.691690 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260810 14:33:06.691975 16479 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:45475: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
I20260810 14:33:06.737942 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } attempt: 2
I20260810 14:33:06.738924 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.738566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:32996)
0810 14:33:06.738748 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.738838 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260810 14:33:06.739832 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.739574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:33002)
0810 14:33:06.739706 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.739767 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260810 14:33:06.739979 16397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:45475: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
W20260810 14:33:06.757871 16485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:06.758234 16485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:06.758348 16485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 14:33:06.760172 16479 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } attempt: 2
I20260810 14:33:06.761176 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.760835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:33008)
0810 14:33:06.761011 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.761085 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 14:33:06.761965 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.761723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:33012)
0810 14:33:06.761854 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.761905 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260810 14:33:06.762110 16479 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:45475: Network error: Client connection negotiation failed: client connection to 127.1.206.124:45475: connect: Connection refused (error 111)
W20260810 14:33:06.763355 16485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:06.763420 16485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:06.763441 16485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:06.763459 16485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:06.763475 16485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:06.769373 16485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:42137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:46651,127.1.206.125:45117,127.1.206.124:45475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab
--principal=kudu/127.1.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:45475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:06.770603 16485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:06.771826 16485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:06.781095 16496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:06.781144 16494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:06.781289 16485 server_base.cc:1034] running on GCE node
W20260810 14:33:06.781106 16493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:06.782084 16485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:06.783452 16485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:06.784657 16485 hybrid_clock.cc:648] HybridClock initialized: now 1786372386784630 us; error 39 us; skew 500 ppm
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:06.787910 16485 init.cc:377] Logged in from keytab as kudu/127.1.206.124@KRBTEST.COM (short username kudu)
I20260810 14:33:06.789062 16485 webserver.cc:460] Webserver started at http://127.1.206.124:41809/ using document root <none> and password file <none>
I20260810 14:33:06.789686 16485 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:06.789798 16485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:06.790053 16485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:06.792378 16485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data/instance:
uuid: "fa8ec2d148234d969c806d9542779af7"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "30e3506ac9427a738fbfaf359c801126"
server_key_iv: "d710b16269e1d355566bf2255c7b78b0"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.793073 16485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/wal/instance:
uuid: "fa8ec2d148234d969c806d9542779af7"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "30e3506ac9427a738fbfaf359c801126"
server_key_iv: "d710b16269e1d355566bf2255c7b78b0"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.797431 16485 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:33:06.801368 16503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:06.803340 16485 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:33:06.803524 16485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/wal
uuid: "fa8ec2d148234d969c806d9542779af7"
format_stamp: "Formatted at 2026-08-10 14:33:06 on dist-test-slave-0b58"
server_key: "30e3506ac9427a738fbfaf359c801126"
server_key_iv: "d710b16269e1d355566bf2255c7b78b0"
server_key_version: "encryptionkey@0"
I20260810 14:33:06.803696 16485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:06.821554 16485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:06.825294 16485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:06.825481 16485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:06.832906 16485 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.124:45475
I20260810 14:33:06.832919 16559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.124:45475 every 8 connection(s)
I20260810 14:33:06.834009 16485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
I20260810 14:33:06.837021 16560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:06.839151 16397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } attempt: 3
I20260810 14:33:06.841636 16560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:33:06.844108 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 16485
I20260810 14:33:06.844286 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786372219863018-1849-0/minicluster-data/master-2/wal/instance
I20260810 14:33:06.844594 1849 external_mini_cluster.cc:1428] Setting key 1ac97a40e3685059a595851fb6aa3b0c
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
I20260810 14:33:06.853302 16479 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } attempt: 3
I20260810 14:33:06.856050 16400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.839797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:33024)
0810 14:33:06.840030 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.840048 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.840143 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.842826 (+ 2683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.842829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.843023 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.843167 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.843174 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.845209 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.845213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.846038 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.846053 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.847269 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.847273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.847378 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.848155 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.848168 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.849785 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.852324 (+ 2539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.852329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.852333 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.852930 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.853457 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.853460 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.853462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.853565 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.855521 (+ 1956us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.855527 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.855630 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.855721 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.855862 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260810 14:33:06.857144 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.843922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:46651 (local address 127.0.0.1:59374)
0810 14:33:06.845557 (+ 1635us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.845625 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.845785 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.846124 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.846131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.846508 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.846626 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.846641 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.847376 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.847379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.848442 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.848450 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.848990 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.848994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.849113 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.849741 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.849762 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.851655 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.853899 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.853908 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.853914 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.854200 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.854518 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.854522 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.854524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.854615 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.855175 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.855186 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.855366 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.855566 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.855920 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1391,"mutex_wait_us":21,"thread_start_us":245,"threads_started":1}
I20260810 14:33:06.857466 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.840587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33024 (local address 127.1.206.124:45475)
0810 14:33:06.841036 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.841058 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.841103 (+ 45us) server_negotiation.cc:407] Connection header received
0810 14:33:06.841968 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.841995 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.842446 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.842845 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.843299 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.844962 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.846192 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.847111 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.847651 (+ 540us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.849944 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.849952 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.849966 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.849993 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.852159 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.853069 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.853077 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.853084 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.853313 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.853692 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.853699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.853704 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.854362 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.857047 (+ 2685us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.857161 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.857306 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":288,"spinlock_wait_cycles":5376,"thread_start_us":133,"threads_started":1}
I20260810 14:33:06.858767 16401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.843936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59374 (local address 127.1.206.126:46651)
0810 14:33:06.844047 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.844052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.845718 (+ 1666us) server_negotiation.cc:407] Connection header received
0810 14:33:06.845903 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.845906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.845967 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.846053 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.846761 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.847251 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.848551 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.848816 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.848937 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.851861 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.851868 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.851871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.851899 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.853787 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.854316 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.854320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.854322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.854413 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.854724 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.854727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.854729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.855049 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.855155 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.858464 (+ 3309us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.858613 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:33:06.859647 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.845306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.1.206.124:45475)
0810 14:33:06.845662 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.845670 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.845921 (+ 251us) server_negotiation.cc:407] Connection header received
0810 14:33:06.846120 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.846126 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.846191 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.846252 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.847375 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.848243 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.849478 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.849855 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.849966 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.853041 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.853047 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.853055 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.853079 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.856899 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.857823 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.857826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.857828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.857917 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.858231 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.858234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.858236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.858449 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.858623 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.859365 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.859480 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":291,"spinlock_wait_cycles":6016,"thread_start_us":119,"threads_started":1}
I20260810 14:33:06.859807 16560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
I20260810 14:33:06.863991 16397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: Bootstrap starting.
I20260810 14:33:06.865075 16482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.853862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:33040)
0810 14:33:06.853989 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.854005 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.854091 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.854802 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.854805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.854992 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.855121 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.855132 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.856067 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.856071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.856742 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.856753 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.858063 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.858070 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.858178 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.859427 (+ 1249us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.859443 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.860982 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.863114 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.863117 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.863119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.863378 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.863725 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.863729 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.863734 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.863917 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.864531 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.864534 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.864632 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.864742 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.864908 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
I20260810 14:33:06.866056 16568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.854159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33040 (local address 127.1.206.124:45475)
0810 14:33:06.854494 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.854506 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.854522 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:33:06.854556 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.854559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.854603 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.854772 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.855230 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.855945 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.856869 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.857164 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.857291 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.861115 (+ 3824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.861119 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.861122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.861145 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.862983 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.863511 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.863514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.863515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.863601 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.864047 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.864050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.864052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.864405 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.865632 (+ 1227us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.865733 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.865873 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":137,"threads_started":1}
I20260810 14:33:06.867851 16397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:06.868850 16397 log.cc:824] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:06.869886 16479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda: Bootstrap starting.
I20260810 14:33:06.871222 16397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: No bootstrap required, opened a new log
I20260810 14:33:06.873070 16479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:06.873961 16401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.862789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59378 (local address 127.1.206.126:46651)
0810 14:33:06.862897 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.862901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.863066 (+ 165us) server_negotiation.cc:407] Connection header received
0810 14:33:06.863228 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.863232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.863274 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.863319 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.864206 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.865033 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.866289 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.866676 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.866762 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.869822 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.869827 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.869829 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.869858 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.871680 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.872292 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.872296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.872298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.872393 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.872734 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.872738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.872740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.873008 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.873180 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.873595 (+ 415us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.873779 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:33:06.874029 16479 log.cc:824] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:06.874809 16397 raft_consensus.cc:348] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
I20260810 14:33:06.875072 16397 raft_consensus.cc:374] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:06.875146 16397 raft_consensus.cc:729] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a168ce1399ac411c9dec9b080c5d175f, State: Initialized, Role: FOLLOWER
I20260810 14:33:06.875633 16397 consensus_queue.cc:260] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
I20260810 14:33:06.876996 16479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda: No bootstrap required, opened a new log
I20260810 14:33:06.877086 16397 sys_catalog.cc:564] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:06.878085 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.860538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:45117 (local address 127.0.0.1:39294)
0810 14:33:06.860713 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.860729 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.860803 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.861276 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.861279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.861462 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.861567 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.861572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.862662 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.862665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.863476 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.863488 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.864346 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.864349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.864457 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.864935 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.864949 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.866470 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.876030 (+ 9560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.876033 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.876035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.876393 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.876727 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.876733 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.876738 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.876841 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.877475 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.877478 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.877595 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.877756 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.877918 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 14:33:06.878594 16483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.860955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39294 (local address 127.1.206.125:45117)
0810 14:33:06.861057 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.861061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.861073 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:33:06.861113 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.861115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.861156 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.861239 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.861749 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.862519 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.863616 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.864037 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.864145 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.866627 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.866630 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.866633 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.866661 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.875864 (+ 9203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.876517 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.876520 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.876523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.876610 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.876975 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.876978 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.876980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.877318 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.877423 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.878317 (+ 894us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.878431 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:33:06.879954 16560 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:33:06.882581 16479 raft_consensus.cc:348] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
W20260810 14:33:06.882810 16586 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:33:06.882903 16586 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:33:06.882864 16479 raft_consensus.cc:374] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:06.883023 16479 raft_consensus.cc:729] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288b526550454c56a2a6e5ce8ed59bda, State: Initialized, Role: FOLLOWER
I20260810 14:33:06.883509 16479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
I20260810 14:33:06.884013 16588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:06.884173 16588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:33:06.885015 16479 sys_catalog.cc:564] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:06.882339 16316 master_runner.cc:186] Error getting master registration for 127.1.206.125:45117: OK, instance_id { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" instance_seqno: 1786372386594518 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:33:06.886485 16316 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:33:06.887364 16573 sys_catalog.cc:455] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:06.887504 16573 sys_catalog.cc:458] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:33:06.889539 16571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.875732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39300 (local address 127.1.206.125:45117)
0810 14:33:06.876519 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.876529 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.876540 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:33:06.876574 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.876578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.876620 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.877477 (+ 857us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.877605 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.878405 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.880928 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.881290 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.881759 (+ 469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.884411 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.884415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.884417 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.884442 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.886253 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.886775 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.886779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.886781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.886900 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.887872 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.887875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.887877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.888111 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.888906 (+ 795us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.888985 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.889108 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":112,"threads_started":1}
Aug 10 14:33:06 dist-test-slave-0b58 krb5kdc[16301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372386, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
W20260810 14:33:06.893294 16599 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:33:06.893369 16599 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:33:06.894462 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:33:06.892874 16405 master_runner.cc:186] Error getting master registration for 127.1.206.124:45475: OK, instance_id { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" instance_seqno: 1786372386830837 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:33:06.895555 16405 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:33:06.900453 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.880466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:45475 (local address 127.0.0.1:33046)
0810 14:33:06.880703 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:06.880718 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:06.880791 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:06.887014 (+ 6223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:06.887017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:06.887205 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:06.887313 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.887321 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.888375 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.888381 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.889090 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:06.889099 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.889720 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.889724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:06.889796 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.890303 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:06.890319 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:06.896693 (+ 6374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:06.898835 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.898838 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.898841 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.899091 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.899385 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:06.899388 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:06.899390 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:06.899472 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:06.899923 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:06.899926 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:06.900011 (+ 85us) client_negotiation.cc:769] Sending connection context
0810 14:33:06.900094 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:33:06.900245 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260810 14:33:06.901010 16568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.880694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33046 (local address 127.1.206.124:45475)
0810 14:33:06.886747 (+ 6053us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.886752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.886779 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:33:06.886828 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.886831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.886890 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.886988 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.887501 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.888231 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.889215 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.889581 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.890012 (+ 431us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.896855 (+ 6843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.896858 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.896861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.896887 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.898714 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.899205 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.899208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.899209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.899287 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.899573 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.899578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.899580 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.899815 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.900666 (+ 851us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.900738 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.900858 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5932}
I20260810 14:33:06.904443 16560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: Bootstrap starting.
I20260810 14:33:06.907969 16560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:06.909214 16560 log.cc:824] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:06.914163 16571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.897661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39304 (local address 127.1.206.125:45117)
0810 14:33:06.897783 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.897787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.900293 (+ 2506us) server_negotiation.cc:407] Connection header received
0810 14:33:06.900476 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.900480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.900529 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.900586 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.903842 (+ 3256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.904668 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.907207 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.907605 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.907711 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.910298 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.910303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.910306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.910337 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.911997 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.912533 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.912537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.912539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.912627 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.912933 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.912936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.912938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.913159 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.913272 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.913847 (+ 575us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.913984 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:33:06.914695 16401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.897294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59392 (local address 127.1.206.126:46651)
0810 14:33:06.897413 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.897417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.898732 (+ 1315us) server_negotiation.cc:407] Connection header received
0810 14:33:06.898939 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.898942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.898994 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.899047 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.901717 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.902516 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.906185 (+ 3669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.906556 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.906646 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.910283 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.910288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.910291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.910326 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.912656 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.913176 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.913180 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.913182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.913278 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.913586 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.913590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.913591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.913835 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.913963 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.914335 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.914460 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 14:33:06.919507 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:06.898306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33056 (local address 127.1.206.124:45475)
0810 14:33:06.898434 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:06.898439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:06.906005 (+ 7566us) server_negotiation.cc:407] Connection header received
0810 14:33:06.906141 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:06.906145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:06.906196 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:06.906281 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:06.908207 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.908999 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.911575 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:06.912012 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:06.912101 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:06.915856 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:06.915860 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:06.915862 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:06.915893 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:06.917688 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.918171 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.918178 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.918181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.918276 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:06.918577 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:06.918580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:06.918583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:06.918826 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:06.918956 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:06.919228 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 14:33:06.919349 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:33:06.922540 16560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: No bootstrap required, opened a new log
I20260810 14:33:06.927480 16560 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
I20260810 14:33:06.927801 16560 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:06.927863 16560 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8ec2d148234d969c806d9542779af7, State: Initialized, Role: FOLLOWER
I20260810 14:33:06.928484 16560 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
I20260810 14:33:06.929090 16610 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:06.929246 16610 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:33:06.930073 16560 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:06.940176 16485 master_runner.cc:263] No leader master found from master fa8ec2d148234d969c806d9542779af7
I20260810 14:33:06.940321 16485 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 14:33:06.941433 16624 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:33:06.941538 16624 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260810 14:33:07.076933 16509 tablet.cc:2369] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:33:07.090409 16428 tablet.cc:2369] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:07.101651 16588 raft_consensus.cc:482] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:07.101903 16588 raft_consensus.cc:504] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
I20260810 14:33:07.103034 16588 leader_election.cc:288] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a168ce1399ac411c9dec9b080c5d175f (127.1.206.126:46651), fa8ec2d148234d969c806d9542779af7 (127.1.206.124:45475)
I20260810 14:33:07.103864 16365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "288b526550454c56a2a6e5ce8ed59bda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a168ce1399ac411c9dec9b080c5d175f" is_pre_election: true
I20260810 14:33:07.103880 16532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "288b526550454c56a2a6e5ce8ed59bda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8ec2d148234d969c806d9542779af7" is_pre_election: true
I20260810 14:33:07.104220 16365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288b526550454c56a2a6e5ce8ed59bda in term 0.
I20260810 14:33:07.104338 16532 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288b526550454c56a2a6e5ce8ed59bda in term 0.
I20260810 14:33:07.104774 16426 leader_election.cc:302] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288b526550454c56a2a6e5ce8ed59bda, fa8ec2d148234d969c806d9542779af7; no voters:
I20260810 14:33:07.105218 16588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:33:07.105340 16588 raft_consensus.cc:482] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:33:07.105402 16588 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:07.106868 16588 raft_consensus.cc:504] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
I20260810 14:33:07.107250 16588 leader_election.cc:288] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [CANDIDATE]: Term 1 election: Requested vote from peers a168ce1399ac411c9dec9b080c5d175f (127.1.206.126:46651), fa8ec2d148234d969c806d9542779af7 (127.1.206.124:45475)
I20260810 14:33:07.107735 16532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "288b526550454c56a2a6e5ce8ed59bda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8ec2d148234d969c806d9542779af7"
I20260810 14:33:07.107739 16365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "288b526550454c56a2a6e5ce8ed59bda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a168ce1399ac411c9dec9b080c5d175f"
I20260810 14:33:07.107890 16365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:07.107877 16532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:07.109437 16532 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288b526550454c56a2a6e5ce8ed59bda in term 1.
I20260810 14:33:07.109501 16365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288b526550454c56a2a6e5ce8ed59bda in term 1.
I20260810 14:33:07.109808 16426 leader_election.cc:302] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288b526550454c56a2a6e5ce8ed59bda, fa8ec2d148234d969c806d9542779af7; no voters:
W20260810 14:33:07.110006 16341 tablet.cc:2369] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:07.110141 16588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:07.110333 16588 raft_consensus.cc:686] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [term 1 LEADER]: Becoming Leader. State: Replica: 288b526550454c56a2a6e5ce8ed59bda, State: Running, Role: LEADER
I20260810 14:33:07.111061 16588 consensus_queue.cc:237] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } }
I20260810 14:33:07.113526 16626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 288b526550454c56a2a6e5ce8ed59bda. Latest consensus state: current_term: 1 leader_uuid: "288b526550454c56a2a6e5ce8ed59bda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:07.113731 16626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:07.114189 16628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:07.115270 16628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:07.120790 16532 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [term 1 FOLLOWER]: Refusing update from remote peer 288b526550454c56a2a6e5ce8ed59bda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:07.120957 16365 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [term 1 FOLLOWER]: Refusing update from remote peer 288b526550454c56a2a6e5ce8ed59bda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:07.121500 16626 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:07.121651 16588 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [LEADER]: Connected to new peer: Peer: permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:07.125564 16610 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 288b526550454c56a2a6e5ce8ed59bda. Latest consensus state: current_term: 1 leader_uuid: "288b526550454c56a2a6e5ce8ed59bda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:07.125718 16610 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:33:07.129381 16573 sys_catalog.cc:455] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 288b526550454c56a2a6e5ce8ed59bda. Latest consensus state: current_term: 1 leader_uuid: "288b526550454c56a2a6e5ce8ed59bda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:07.129541 16573 sys_catalog.cc:458] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:33:07.131680 16635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "288b526550454c56a2a6e5ce8ed59bda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:07.131737 16626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "288b526550454c56a2a6e5ce8ed59bda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:07.131922 16626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:07.131903 16635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:07.133420 16573 sys_catalog.cc:455] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "288b526550454c56a2a6e5ce8ed59bda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:07.133551 16573 sys_catalog.cc:458] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:33:07.133908 16610 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "288b526550454c56a2a6e5ce8ed59bda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a168ce1399ac411c9dec9b080c5d175f" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 46651 } } peers { permanent_uuid: "288b526550454c56a2a6e5ce8ed59bda" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 45117 } } peers { permanent_uuid: "fa8ec2d148234d969c806d9542779af7" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 45475 } } }
I20260810 14:33:07.134060 16610 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:33:07.136164 16629 mvcc.cc:205] Tried to move back new op lower bound from 7316981297639571456 to 7316981297609736192. Current Snapshot: MvccSnapshot[applied={T|T < 7316981297639571456}]
I20260810 14:33:07.137596 16628 catalog_manager.cc:1347] Generated new cluster ID: d182e621e8e24cc1afa64f1cbb92b018
I20260810 14:33:07.137668 16628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:33:07.147393 16628 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:33:07.148788 16628 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:33:07.163204 16628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 288b526550454c56a2a6e5ce8ed59bda: Generated new TSK 0
I20260810 14:33:07.164397 16628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:33:07.884217 16586 catalog_manager.cc:1259] Loaded cluster ID: d182e621e8e24cc1afa64f1cbb92b018
I20260810 14:33:07.884361 16586 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: loading cluster ID for follower catalog manager: success
I20260810 14:33:07.886272 16586 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: acquiring CA information for follower catalog manager: success
I20260810 14:33:07.887531 16586 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a168ce1399ac411c9dec9b080c5d175f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:33:07.942907 16624 catalog_manager.cc:1259] Loaded cluster ID: d182e621e8e24cc1afa64f1cbb92b018
I20260810 14:33:07.943034 16624 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: loading cluster ID for follower catalog manager: success
I20260810 14:33:07.944837 16624 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: acquiring CA information for follower catalog manager: success
I20260810 14:33:07.946058 16624 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fa8ec2d148234d969c806d9542779af7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:33:08.235073 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 16316
I20260810 14:33:08.244390 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 16405
I20260810 14:33:08.252364 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 16485
2026-08-10T14:33:08Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3302 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:33:08 dist-test-slave-0b58 krb5kdc[16647](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:33:08 dist-test-slave-0b58 krb5kdc[16647](info): set up 2 sockets
Aug 10 14:33:08 dist-test-slave-0b58 krb5kdc[16647](info): commencing operation
krb5kdc: starting...
W20260810 14:33:09.341262 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:33:09 dist-test-slave-0b58 krb5kdc[16647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:33:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:33:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:33:09.477797 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:35353
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:35353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:09.597438 16660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:09.597797 16660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:09.597887 16660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:09.602350 16660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:09.602466 16660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:09.602501 16660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:09.602546 16660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:09.602582 16660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:09.608384 16660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:35353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:35353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:09.609833 16660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:09.611111 16660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:09.620111 16665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:09.620095 16670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:09.620095 16668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:09.620440 16660 server_base.cc:1034] running on GCE node
I20260810 14:33:09.621130 16660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:09.622375 16660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:09.623555 16660 hybrid_clock.cc:648] HybridClock initialized: now 1786372389623518 us; error 50 us; skew 500 ppm
Aug 10 14:33:09 dist-test-slave-0b58 krb5kdc[16647](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372389, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:09.626515 16660 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:09.627547 16660 webserver.cc:460] Webserver started at http://127.1.206.126:33147/ using document root <none> and password file <none>
I20260810 14:33:09.628159 16660 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:09.628268 16660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:09.628551 16660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:09.630781 16660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "349cf14095a44e49b4c69da55c841bdd"
format_stamp: "Formatted at 2026-08-10 14:33:09 on dist-test-slave-0b58"
server_key: "0fdc50f0d4284ab76fdf8c1c05444f2e"
server_key_iv: "f348b9bb23f59c98410eac1906d571e6"
server_key_version: "encryptionkey@0"
I20260810 14:33:09.631415 16660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "349cf14095a44e49b4c69da55c841bdd"
format_stamp: "Formatted at 2026-08-10 14:33:09 on dist-test-slave-0b58"
server_key: "0fdc50f0d4284ab76fdf8c1c05444f2e"
server_key_iv: "f348b9bb23f59c98410eac1906d571e6"
server_key_version: "encryptionkey@0"
I20260810 14:33:09.635543 16660 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:33:09.638319 16677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:09.639642 16660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 14:33:09.639818 16660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "349cf14095a44e49b4c69da55c841bdd"
format_stamp: "Formatted at 2026-08-10 14:33:09 on dist-test-slave-0b58"
server_key: "0fdc50f0d4284ab76fdf8c1c05444f2e"
server_key_iv: "f348b9bb23f59c98410eac1906d571e6"
server_key_version: "encryptionkey@0"
I20260810 14:33:09.639954 16660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:09.653906 16660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:09.657166 16660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:09.657402 16660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:09.665067 16660 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:35353
I20260810 14:33:09.665096 16735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:35353 every 8 connection(s)
I20260810 14:33:09.666145 16660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:09.669162 16736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:09.675223 16736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd: Bootstrap starting.
I20260810 14:33:09.676044 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 16660
I20260810 14:33:09.676180 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:33:09.676517 1849 external_mini_cluster.cc:1428] Setting key 25f67adafe02609d45f5a6362f6e6504
I20260810 14:33:09.678550 16736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:09.679348 16736 log.cc:824] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:09.681787 16736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd: No bootstrap required, opened a new log
Aug 10 14:33:09 dist-test-slave-0b58 krb5kdc[16647](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:09.686707 16736 raft_consensus.cc:348] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349cf14095a44e49b4c69da55c841bdd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35353 } }
I20260810 14:33:09.687004 16736 raft_consensus.cc:374] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:09.687069 16736 raft_consensus.cc:729] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 349cf14095a44e49b4c69da55c841bdd, State: Initialized, Role: FOLLOWER
I20260810 14:33:09.687598 16736 consensus_queue.cc:260] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349cf14095a44e49b4c69da55c841bdd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35353 } }
I20260810 14:33:09.687783 16736 raft_consensus.cc:388] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:33:09.687876 16736 raft_consensus.cc:482] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:33:09.687994 16736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:09.689069 16736 raft_consensus.cc:504] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349cf14095a44e49b4c69da55c841bdd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35353 } }
I20260810 14:33:09.689453 16736 leader_election.cc:302] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 349cf14095a44e49b4c69da55c841bdd; no voters:
I20260810 14:33:09.689810 16736 leader_election.cc:288] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:33:09.689978 16743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:09.690232 16743 raft_consensus.cc:686] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [term 1 LEADER]: Becoming Leader. State: Replica: 349cf14095a44e49b4c69da55c841bdd, State: Running, Role: LEADER
I20260810 14:33:09.690632 16743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349cf14095a44e49b4c69da55c841bdd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35353 } }
I20260810 14:33:09.691346 16736 sys_catalog.cc:564] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:09.692551 16745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 349cf14095a44e49b4c69da55c841bdd. Latest consensus state: current_term: 1 leader_uuid: "349cf14095a44e49b4c69da55c841bdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349cf14095a44e49b4c69da55c841bdd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35353 } } }
I20260810 14:33:09.692682 16745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:09.692699 16741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:09.677967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45410 (local address 127.1.206.126:35353)
0810 14:33:09.678442 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:09.678458 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:09.678495 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:33:09.679265 (+ 770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:09.679284 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:09.679694 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:09.680109 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:09.681040 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:09.682125 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:09.683322 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:09.683836 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:09.683976 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:09.687054 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:09.687062 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:09.687081 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:09.687122 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:09.689102 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:09.689609 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:09.689615 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:09.689622 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:09.689764 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:09.690153 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:09.690157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:09.690159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:09.690700 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:09.690948 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:09.691261 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 14:33:09.691608 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":142,"threads_started":1}
I20260810 14:33:09.693025 16744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "349cf14095a44e49b4c69da55c841bdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "349cf14095a44e49b4c69da55c841bdd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35353 } } }
I20260810 14:33:09.693111 16744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:09.696050 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 14:33:09.696867 16759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:33:09.696965 16759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:33:09.697088 16752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:09.698069 16752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:09.704026 16752 catalog_manager.cc:1347] Generated new cluster ID: a6dbc4e65fb6443bbf9134a94bfd032e
I20260810 14:33:09.704123 16752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:33:09.714180 16752 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:33:09.715339 16752 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:33:09.722497 16752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 349cf14095a44e49b4c69da55c841bdd: Generated new TSK 0
I20260810 14:33:09.723356 16752 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:33:09.752899 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 16660
2026-08-10T14:33:09Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1500 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:33:09 dist-test-slave-0b58 krb5kdc[16766](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:33:09 dist-test-slave-0b58 krb5kdc[16766](info): set up 2 sockets
Aug 10 14:33:09 dist-test-slave-0b58 krb5kdc[16766](info): commencing operation
krb5kdc: starting...
W20260810 14:33:10.851600 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:33:10 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:33:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:33:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:33:10.986999 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43381
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:43381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:11.104593 16779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:11.104890 16779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:11.104934 16779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:11.109226 16779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:11.109300 16779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:11.109320 16779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:11.109337 16779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:11.109354 16779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:11.115029 16779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:43381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:11.116196 16779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:11.117311 16779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:11.126262 16785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:11.126264 16784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:11.126308 16779 server_base.cc:1034] running on GCE node
W20260810 14:33:11.126312 16787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:11.127126 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:11.128371 16779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:11.129546 16779 hybrid_clock.cc:648] HybridClock initialized: now 1786372391129505 us; error 54 us; skew 500 ppm
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372391, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:11.132563 16779 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:11.133569 16779 webserver.cc:460] Webserver started at http://127.1.206.126:40549/ using document root <none> and password file <none>
I20260810 14:33:11.134191 16779 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:11.134261 16779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:11.134442 16779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:11.136669 16779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "9d7d637883f8455e8365ae7203da45cd"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3f4ad2c882a23c291da838d67f8e0b00"
server_key_iv: "58a393a9d4e3f49e551a74647e1be7eb"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.137338 16779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "9d7d637883f8455e8365ae7203da45cd"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3f4ad2c882a23c291da838d67f8e0b00"
server_key_iv: "58a393a9d4e3f49e551a74647e1be7eb"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.141320 16779 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:33:11.143869 16795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.145293 16779 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:33:11.145439 16779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "9d7d637883f8455e8365ae7203da45cd"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3f4ad2c882a23c291da838d67f8e0b00"
server_key_iv: "58a393a9d4e3f49e551a74647e1be7eb"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.145552 16779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:11.171191 16779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:11.174963 16779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:11.175189 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:11.183403 16779 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:43381
I20260810 14:33:11.183813 16855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:43381 every 8 connection(s)
I20260810 14:33:11.184640 16779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:11.187723 16856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:11.193899 16856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Bootstrap starting.
I20260810 14:33:11.194916 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 16779
I20260810 14:33:11.195030 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:33:11.195304 1849 external_mini_cluster.cc:1428] Setting key 1560f8e2a8881603378212fc55a4212a
I20260810 14:33:11.196887 16856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:11.197813 16856 log.cc:824] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:11.200116 16856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: No bootstrap required, opened a new log
I20260810 14:33:11.204569 16856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:11.204816 16856 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:11.204878 16856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d7d637883f8455e8365ae7203da45cd, State: Initialized, Role: FOLLOWER
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:11.205323 16856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:11.205482 16856 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:33:11.205585 16856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:33:11.205715 16856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:11.207073 16856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:11.207515 16856 leader_election.cc:302] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d7d637883f8455e8365ae7203da45cd; no voters:
I20260810 14:33:11.207888 16856 leader_election.cc:288] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:33:11.208029 16862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:11.208348 16862 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 LEADER]: Becoming Leader. State: Replica: 9d7d637883f8455e8365ae7203da45cd, State: Running, Role: LEADER
I20260810 14:33:11.208703 16862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:11.209419 16856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:11.210464 16863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d7d637883f8455e8365ae7203da45cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } } }
I20260810 14:33:11.210604 16863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:11.211230 16864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d7d637883f8455e8365ae7203da45cd. Latest consensus state: current_term: 1 leader_uuid: "9d7d637883f8455e8365ae7203da45cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } } }
I20260810 14:33:11.211407 16864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:11.212646 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.196546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36586 (local address 127.1.206.126:43381)
0810 14:33:11.197089 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:11.197113 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:11.197163 (+ 50us) server_negotiation.cc:407] Connection header received
0810 14:33:11.198074 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:11.198100 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:11.198492 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:11.198874 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:11.199581 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.201129 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.202076 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.202871 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.203080 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.206133 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:11.206140 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:11.206159 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:11.206194 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:11.208410 (+ 2216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.208983 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.208989 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.208995 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.209141 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.209551 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.209555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.209556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.210136 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:11.211081 (+ 945us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:11.211271 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 14:33:11.211606 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":168,"threads_started":1}
W20260810 14:33:11.214944 16877 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:33:11.215050 16877 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:33:11.215137 16871 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:11.215934 16871 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:11.222007 16871 catalog_manager.cc:1347] Generated new cluster ID: 6f908915a6db40f5b42a010270246f1d
I20260810 14:33:11.222139 16871 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:33:11.231758 16871 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:33:11.233145 16871 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:33:11.248899 16871 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Generated new TSK 0
I20260810 14:33:11.249877 16871 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:33:11.281179 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43381
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:11.407315 16884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:11.407608 16884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:11.407655 16884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:11.412022 16884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:11.412104 16884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:11.412168 16884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:33:11.417609 16884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:11.418676 16884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:11.419746 16884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:11.429900 16892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:11.429917 16889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:11.429900 16890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:11.430238 16884 server_base.cc:1034] running on GCE node
I20260810 14:33:11.430784 16884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:11.431545 16884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:11.432731 16884 hybrid_clock.cc:648] HybridClock initialized: now 1786372391432713 us; error 36 us; skew 500 ppm
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372391, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:11.439270 16884 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:33:11.440241 16884 webserver.cc:460] Webserver started at http://127.1.206.65:39393/ using document root <none> and password file <none>
I20260810 14:33:11.440860 16884 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:11.440922 16884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:11.441094 16884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:11.443138 16884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "34639c83c971438f9197057234b1b85b"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3fca74e2733d85e2f23c82ef8a29a651"
server_key_iv: "4ce69de6ec9d77b1da3543d75ea8836c"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.443687 16884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "34639c83c971438f9197057234b1b85b"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3fca74e2733d85e2f23c82ef8a29a651"
server_key_iv: "4ce69de6ec9d77b1da3543d75ea8836c"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.447501 16884 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 14:33:11.450263 16899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.451546 16884 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:33:11.451649 16884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "34639c83c971438f9197057234b1b85b"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3fca74e2733d85e2f23c82ef8a29a651"
server_key_iv: "4ce69de6ec9d77b1da3543d75ea8836c"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.451746 16884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:11.462914 16884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:11.466367 16884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:11.466534 16884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:11.467082 16884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:11.467897 16884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:11.467947 16884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.467989 16884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:11.468004 16884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.478106 16884 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:45421
I20260810 14:33:11.478125 17026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:45421 every 8 connection(s)
I20260810 14:33:11.479099 16884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372391, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:11.489442 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 16884
I20260810 14:33:11.489610 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:33:11.489965 1849 external_mini_cluster.cc:1428] Setting key 15e05ec85917afc8d816a8c5a0038c7b
I20260810 14:33:11.493511 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.481268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:51889 (local address 127.1.206.126:43381)
0810 14:33:11.481522 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:11.481526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:11.482516 (+ 990us) server_negotiation.cc:407] Connection header received
0810 14:33:11.483382 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:11.483385 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:11.483435 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:11.483513 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:11.484807 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.485345 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.486530 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.486803 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.486902 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.489583 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:11.489587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:11.489590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:11.489626 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:11.491210 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.491803 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.491809 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.491812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.491908 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.492237 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.492243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.492247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.492525 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:11.492636 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:11.493112 (+ 476us) server_negotiation.cc:299] Negotiation successful
0810 14:33:11.493260 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260810 14:33:11.494419 17030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.481654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:51889)
0810 14:33:11.482374 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:11.482419 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:11.483175 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:11.483684 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:11.483690 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:11.484057 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:11.484627 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:11.484641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.485467 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.485469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:11.486381 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:11.486390 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.486957 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.486959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:11.487096 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.487723 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:11.487738 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:11.489363 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:11.491337 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:11.491344 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:11.491360 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:11.491677 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:11.492007 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:11.492009 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:11.492010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:11.492142 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:11.492628 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:11.492633 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:11.492874 (+ 241us) client_negotiation.cc:769] Sending connection context
0810 14:33:11.493035 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 14:33:11.493290 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":128,"threads_started":1}
I20260810 14:33:11.495684 17028 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43381
I20260810 14:33:11.495941 17028 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:11.496511 17028 heartbeater.cc:511] Master 127.1.206.126:43381 requested a full tablet report, sending...
I20260810 14:33:11.498111 16816 ts_manager.cc:194] Registered new tserver with Master: 34639c83c971438f9197057234b1b85b (127.1.206.65:45421)
I20260810 14:33:11.499225 16816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:51889
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:33:11.519678 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43381
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:11.634644 17035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:11.635179 17035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:11.635310 17035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:11.639724 17035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:11.639835 17035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:11.639936 17035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:33:11.645483 17035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:11.646690 17035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:11.647724 17035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:11.657907 17041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:11.657945 17040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:11.657946 17043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:11.658363 17035 server_base.cc:1034] running on GCE node
I20260810 14:33:11.658763 17035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:11.659436 17035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:11.660604 17035 hybrid_clock.cc:648] HybridClock initialized: now 1786372391660569 us; error 49 us; skew 500 ppm
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372391, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:11.663420 17035 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:33:11.664328 17035 webserver.cc:460] Webserver started at http://127.1.206.66:45113/ using document root <none> and password file <none>
I20260810 14:33:11.664878 17035 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:11.664938 17035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:11.665104 17035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:11.667114 17035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "83a7f100e3034601922178b324bd9c92"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "0de8bad7fb5132bcdd46488a7c1c12f2"
server_key_iv: "95222866e0056f63dd3074331a0beefe"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.667652 17035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "83a7f100e3034601922178b324bd9c92"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "0de8bad7fb5132bcdd46488a7c1c12f2"
server_key_iv: "95222866e0056f63dd3074331a0beefe"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.671381 17035 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:33:11.673884 17050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.675458 17035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:33:11.675581 17035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "83a7f100e3034601922178b324bd9c92"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "0de8bad7fb5132bcdd46488a7c1c12f2"
server_key_iv: "95222866e0056f63dd3074331a0beefe"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.675701 17035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:11.696192 17035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:11.699832 17035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:11.700054 17035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:11.700738 17035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:11.701594 17035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:11.701642 17035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.701709 17035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:11.701746 17035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.710829 17035 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:46541
I20260810 14:33:11.710891 17182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:46541 every 8 connection(s)
I20260810 14:33:11.711915 17035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:33:11.717597 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 17035
I20260810 14:33:11.717731 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:33:11.718046 1849 external_mini_cluster.cc:1428] Setting key 27c290fdd17b1896f76c62a0563638d8
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372391, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:11.727039 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.713915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:50483 (local address 127.1.206.126:43381)
0810 14:33:11.714064 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:11.714068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:11.715183 (+ 1115us) server_negotiation.cc:407] Connection header received
0810 14:33:11.716057 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:11.716060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:11.716108 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:11.716188 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:11.717459 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.718266 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.719676 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.720013 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.720145 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.722809 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:11.722817 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:11.722823 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:11.722860 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:11.724658 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.725215 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.725218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.725220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.725326 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.725677 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.725683 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.725686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.725989 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:11.726122 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:11.726644 (+ 522us) server_negotiation.cc:299] Negotiation successful
0810 14:33:11.726811 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:33:11.727770 17185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.714339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:50483)
0810 14:33:11.715025 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:11.715068 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:11.715840 (+ 772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:11.716436 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:11.716442 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:11.716823 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:11.717301 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:11.717315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.718401 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.718404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:11.719559 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:11.719569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.720190 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.720193 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:11.720427 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.721066 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:11.721083 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:11.722602 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:11.724794 (+ 2192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:11.724799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:11.724817 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:11.725103 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:11.725432 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:11.725434 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:11.725436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:11.725575 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:11.726121 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:11.726126 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:11.726385 (+ 259us) client_negotiation.cc:769] Sending connection context
0810 14:33:11.726548 (+ 163us) client_negotiation.cc:240] Negotiation successful
0810 14:33:11.726825 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":129,"threads_started":1}
I20260810 14:33:11.729220 17183 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43381
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:33:11.729485 17183 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:11.730007 17183 heartbeater.cc:511] Master 127.1.206.126:43381 requested a full tablet report, sending...
I20260810 14:33:11.731096 16816 ts_manager.cc:194] Registered new tserver with Master: 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
I20260810 14:33:11.731706 16816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:50483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:33:11.747282 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43381
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:11.869521 17188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:11.869791 17188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:11.869835 17188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:11.873859 17188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:11.873927 17188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:11.873987 17188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:33:11.879537 17188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:11.880806 17188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:11.881851 17188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:11.891849 17196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:11.891924 17195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:11.891848 17198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:11.892200 17188 server_base.cc:1034] running on GCE node
I20260810 14:33:11.892678 17188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:11.893355 17188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:11.894560 17188 hybrid_clock.cc:648] HybridClock initialized: now 1786372391894543 us; error 32 us; skew 500 ppm
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372391, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:11.897421 17188 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:33:11.898373 17188 webserver.cc:460] Webserver started at http://127.1.206.67:36287/ using document root <none> and password file <none>
I20260810 14:33:11.898960 17188 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:11.899058 17188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:11.899312 17188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:11.901471 17188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "4f4ee927ae7e49deb02c1929f1f3e417"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "723fcf9077f19b533616b98e307f5f23"
server_key_iv: "e1ac390b13efbaf67cdfba2762067059"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.902069 17188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "4f4ee927ae7e49deb02c1929f1f3e417"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "723fcf9077f19b533616b98e307f5f23"
server_key_iv: "e1ac390b13efbaf67cdfba2762067059"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.906149 17188 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:33:11.908692 17205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.909979 17188 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:33:11.910130 17188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "4f4ee927ae7e49deb02c1929f1f3e417"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "723fcf9077f19b533616b98e307f5f23"
server_key_iv: "e1ac390b13efbaf67cdfba2762067059"
server_key_version: "encryptionkey@0"
I20260810 14:33:11.910266 17188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:11.929229 17188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:11.932392 17188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:11.932605 17188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:11.933238 17188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:11.934090 17188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:11.934139 17188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.934180 17188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:11.934238 17188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:11.943864 17188 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:38645
I20260810 14:33:11.943893 17334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:38645 every 8 connection(s)
I20260810 14:33:11.944931 17188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:33:11.945642 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 17188
I20260810 14:33:11.945758 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:33:11.946054 1849 external_mini_cluster.cc:1428] Setting key 5815e5ba5ddbb1791c3c93a41a557509
Aug 10 14:33:11 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372391, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:11.959374 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.947008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44207 (local address 127.1.206.126:43381)
0810 14:33:11.947167 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:11.947172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:11.948550 (+ 1378us) server_negotiation.cc:407] Connection header received
0810 14:33:11.949564 (+ 1014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:11.949568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:11.949628 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:11.949734 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:11.950949 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.951503 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.952784 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.953016 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.953125 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.955935 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:11.955939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:11.955941 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:11.955970 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:11.957348 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.957853 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.957856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.957857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.957935 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.958231 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.958233 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.958234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.958437 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:11.958514 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:11.959057 (+ 543us) server_negotiation.cc:299] Negotiation successful
0810 14:33:11.959191 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 14:33:11.960412 17337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.947571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:44207)
0810 14:33:11.948382 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:11.948443 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:11.949339 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:11.949923 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:11.949930 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:11.950296 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:11.950792 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:11.950806 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.951637 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.951641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:11.952646 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:11.952657 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.953185 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.953189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:11.953378 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.954058 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:11.954076 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:11.955744 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:11.957458 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:11.957464 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:11.957478 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:11.957750 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:11.958014 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:11.958016 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:11.958017 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:11.958153 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:11.958525 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:11.958531 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:11.958776 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 14:33:11.959008 (+ 232us) client_negotiation.cc:240] Negotiation successful
0810 14:33:11.959352 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":112,"threads_started":1}
I20260810 14:33:11.961504 17335 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43381
I20260810 14:33:11.961758 17335 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:11.962267 17335 heartbeater.cc:511] Master 127.1.206.126:43381 requested a full tablet report, sending...
I20260810 14:33:11.963353 16816 ts_manager.cc:194] Registered new tserver with Master: 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645)
I20260810 14:33:11.963948 16816 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:44207
I20260810 14:33:11.972990 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:33:11.983340 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.975078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36602 (local address 127.1.206.126:43381)
0810 14:33:11.975289 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:11.975292 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:11.975368 (+ 76us) server_negotiation.cc:407] Connection header received
0810 14:33:11.975468 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:11.975471 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:11.975515 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:11.975586 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:11.976379 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.976911 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.977736 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:11.977956 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:11.978039 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:11.979559 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:11.979563 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:11.979565 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:11.979593 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:11.981378 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.981891 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.981895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.981897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.981992 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:11.982305 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:11.982309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:11.982310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:11.982572 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:11.982756 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:11.983034 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 14:33:11.983162 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 14:33:11.986545 16816 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:33:11.989684 16816 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:33:12.005077 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.999319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48352 (local address 127.1.206.65:45421)
0810 14:33:12.000175 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.000181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.000203 (+ 22us) server_negotiation.cc:407] Connection header received
0810 14:33:12.000308 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.000313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.000484 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.000619 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:12.000906 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.001658 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.003691 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.004246 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.004426 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.004618 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.004792 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.004913 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":90,"threads_started":1}
I20260810 14:33:12.005069 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.998556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45421 (local address 127.0.0.1:48352)
0810 14:33:11.999761 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:11.999777 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:11.999864 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.000600 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.000604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.000622 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:12.000785 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.000793 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.001782 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.001788 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.003520 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.003532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.004437 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.004441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.004567 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.004618 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.004738 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.004929 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1137,"mutex_wait_us":111,"thread_start_us":101,"threads_started":1}
I20260810 14:33:12.005201 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.999326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52440 (local address 127.1.206.66:46541)
0810 14:33:12.000047 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.000057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.000076 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:33:12.000135 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.000139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.000340 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.000484 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:12.000957 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.002091 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.003438 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.004334 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.004450 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.004619 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.004950 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.005046 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":140,"threads_started":1}
I20260810 14:33:12.005345 17353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.998621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46398 (local address 127.1.206.67:38645)
0810 14:33:11.999439 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:11.999453 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:11.999479 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:33:11.999730 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:11.999736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.000154 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.000361 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:12.000688 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.001930 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.003661 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.004484 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.004925 (+ 441us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.005060 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.005106 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.005185 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":97,"threads_started":1}
I20260810 14:33:12.005589 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.998513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38645 (local address 127.0.0.1:46398)
0810 14:33:11.999343 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:11.999398 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:11.999532 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.000355 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.000361 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.000386 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:12.000546 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.000554 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.002229 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.002232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.003520 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.003532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.004618 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.004622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.004719 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.004741 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.004794 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.005467 (+ 673us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":639,"thread_start_us":98,"threads_started":1}
I20260810 14:33:12.006057 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:11.998808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46541 (local address 127.0.0.1:52440)
0810 14:33:11.999819 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:11.999832 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:11.999912 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.000649 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.000651 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.000679 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:12.000821 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.000828 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.002231 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.002237 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.003299 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.003316 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.004670 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.004674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.004744 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.004761 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.004837 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.005938 (+ 1101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":951,"mutex_wait_us":1064,"spinlock_wait_cycles":1792,"thread_start_us":87,"threads_started":1}
I20260810 14:33:12.008484 17259 tablet_service.cc:1467] Processing CreateTablet for tablet 9064ec03376d4659997914da40000dc8 (DEFAULT_TABLE table=test-table [id=b04eb23b6bce4dbcaa3f7d97f46779dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:12.008543 16952 tablet_service.cc:1467] Processing CreateTablet for tablet 9064ec03376d4659997914da40000dc8 (DEFAULT_TABLE table=test-table [id=b04eb23b6bce4dbcaa3f7d97f46779dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:12.008541 17104 tablet_service.cc:1467] Processing CreateTablet for tablet 9064ec03376d4659997914da40000dc8 (DEFAULT_TABLE table=test-table [id=b04eb23b6bce4dbcaa3f7d97f46779dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:12.009580 17259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9064ec03376d4659997914da40000dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:12.009599 16952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9064ec03376d4659997914da40000dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:12.009593 17104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9064ec03376d4659997914da40000dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:12.016485 17357 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Bootstrap starting.
I20260810 14:33:12.017946 17359 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Bootstrap starting.
I20260810 14:33:12.019079 17357 tablet_bootstrap.cc:654] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:12.019960 17359 tablet_bootstrap.cc:654] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:12.020203 17357 log.cc:824] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:12.020653 17358 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Bootstrap starting.
I20260810 14:33:12.020797 17359 log.cc:824] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:12.022501 17357 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: No bootstrap required, opened a new log
I20260810 14:33:12.022511 17358 tablet_bootstrap.cc:654] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:12.022711 17359 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: No bootstrap required, opened a new log
I20260810 14:33:12.022712 17357 ts_tablet_manager.cc:1397] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:33:12.022864 17359 ts_tablet_manager.cc:1397] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 14:33:12.023276 17358 log.cc:824] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:12.024935 17358 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: No bootstrap required, opened a new log
I20260810 14:33:12.025125 17358 ts_tablet_manager.cc:1397] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 14:33:12.026732 17359 raft_consensus.cc:348] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.026732 17357 raft_consensus.cc:348] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.027029 17359 raft_consensus.cc:374] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:12.027029 17357 raft_consensus.cc:374] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:12.027098 17357 raft_consensus.cc:729] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f4ee927ae7e49deb02c1929f1f3e417, State: Initialized, Role: FOLLOWER
I20260810 14:33:12.027089 17359 raft_consensus.cc:729] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a7f100e3034601922178b324bd9c92, State: Initialized, Role: FOLLOWER
I20260810 14:33:12.027560 17359 consensus_queue.cc:260] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.027560 17357 consensus_queue.cc:260] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.028260 17183 heartbeater.cc:503] Master 127.1.206.126:43381 was elected leader, sending a full tablet report...
I20260810 14:33:12.028565 17335 heartbeater.cc:503] Master 127.1.206.126:43381 was elected leader, sending a full tablet report...
I20260810 14:33:12.028618 17359 ts_tablet_manager.cc:1428] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 14:33:12.028618 17357 ts_tablet_manager.cc:1428] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260810 14:33:12.031039 17358 raft_consensus.cc:348] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.031265 17358 raft_consensus.cc:374] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:12.031354 17358 raft_consensus.cc:729] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34639c83c971438f9197057234b1b85b, State: Initialized, Role: FOLLOWER
I20260810 14:33:12.031797 17358 consensus_queue.cc:260] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.032862 17358 ts_tablet_manager.cc:1428] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 14:33:12.034370 17028 heartbeater.cc:503] Master 127.1.206.126:43381 was elected leader, sending a full tablet report...
I20260810 14:33:12.048936 17365 raft_consensus.cc:482] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:12.049180 17365 raft_consensus.cc:504] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.050292 17365 leader_election.cc:288] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645), 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
I20260810 14:33:12.054332 17353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.050685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:59335 (local address 127.1.206.67:38645)
0810 14:33:12.050861 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.050866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.051089 (+ 223us) server_negotiation.cc:407] Connection header received
0810 14:33:12.051253 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.051256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.051315 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.051399 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:12.051680 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.052185 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.053362 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.053768 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.053898 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.053951 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.054143 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.054215 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260810 14:33:12.054358 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.050551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38645 (local address 127.1.206.65:59335)
0810 14:33:12.050992 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:12.051005 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:12.051141 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.051411 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.051414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.051429 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:12.051568 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.051574 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.052324 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.052330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.053199 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.053209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.053894 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.053898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.053995 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.054018 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.054117 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.054188 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":17,"thread_start_us":135,"threads_started":1}
I20260810 14:33:12.054497 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.050768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:60523 (local address 127.1.206.66:46541)
0810 14:33:12.050890 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.050894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.051224 (+ 330us) server_negotiation.cc:407] Connection header received
0810 14:33:12.051383 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.051386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.051441 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.051526 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:12.051795 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.052380 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.053420 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.053829 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.053958 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.054012 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.054252 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.054336 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 14:33:12.054867 17366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.050551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46541 (local address 127.1.206.65:60523)
0810 14:33:12.051092 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:12.051133 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:12.051267 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.051538 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.051541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.051556 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:12.051686 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.051692 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.052492 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.052498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.053289 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.053299 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.053952 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.053956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.054066 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.054123 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.054646 (+ 523us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.054720 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":129,"thread_start_us":71,"threads_started":1}
I20260810 14:33:12.054996 17282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9064ec03376d4659997914da40000dc8" candidate_uuid: "34639c83c971438f9197057234b1b85b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" is_pre_election: true
I20260810 14:33:12.055274 17282 raft_consensus.cc:2454] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34639c83c971438f9197057234b1b85b in term 0.
I20260810 14:33:12.055775 16900 leader_election.cc:302] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34639c83c971438f9197057234b1b85b, 4f4ee927ae7e49deb02c1929f1f3e417; no voters:
I20260810 14:33:12.056110 17365 raft_consensus.cc:2781] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:33:12.056150 17128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9064ec03376d4659997914da40000dc8" candidate_uuid: "34639c83c971438f9197057234b1b85b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a7f100e3034601922178b324bd9c92" is_pre_election: true
I20260810 14:33:12.056226 17365 raft_consensus.cc:482] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:33:12.056310 17365 raft_consensus.cc:3037] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:12.056460 17128 raft_consensus.cc:2454] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34639c83c971438f9197057234b1b85b in term 0.
I20260810 14:33:12.057581 17365 raft_consensus.cc:504] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.058027 17365 leader_election.cc:288] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 1 election: Requested vote from peers 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645), 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
I20260810 14:33:12.058403 17128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9064ec03376d4659997914da40000dc8" candidate_uuid: "34639c83c971438f9197057234b1b85b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a7f100e3034601922178b324bd9c92"
I20260810 14:33:12.058422 17282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9064ec03376d4659997914da40000dc8" candidate_uuid: "34639c83c971438f9197057234b1b85b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f4ee927ae7e49deb02c1929f1f3e417"
I20260810 14:33:12.058539 17128 raft_consensus.cc:3037] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:12.058560 17282 raft_consensus.cc:3037] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:12.059613 17128 raft_consensus.cc:2454] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34639c83c971438f9197057234b1b85b in term 1.
I20260810 14:33:12.059638 17282 raft_consensus.cc:2454] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34639c83c971438f9197057234b1b85b in term 1.
I20260810 14:33:12.059916 16903 leader_election.cc:302] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34639c83c971438f9197057234b1b85b, 83a7f100e3034601922178b324bd9c92; no voters:
I20260810 14:33:12.060113 17365 raft_consensus.cc:2781] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:12.060390 17365 raft_consensus.cc:686] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 LEADER]: Becoming Leader. State: Replica: 34639c83c971438f9197057234b1b85b, State: Running, Role: LEADER
I20260810 14:33:12.060762 17365 consensus_queue.cc:237] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.063995 16815 catalog_manager.cc:5495] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b reported cstate change: term changed from 0 to 1, leader changed from <none> to 34639c83c971438f9197057234b1b85b (127.1.206.65). New cstate: current_term: 1 leader_uuid: "34639c83c971438f9197057234b1b85b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } health_report { overall_health: UNKNOWN } } }
I20260810 14:33:12.086671 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.083159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48360 (local address 127.1.206.65:45421)
0810 14:33:12.083296 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.083299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.083312 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:33:12.083392 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.083394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.083449 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.083553 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:33:12.083843 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.084408 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.085272 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.085486 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.085573 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.085842 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:33:12.086280 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:33:12.086370 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.086501 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.086554 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:33:12.092500 17128 raft_consensus.cc:1261] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Refusing update from remote peer 34639c83c971438f9197057234b1b85b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:12.092500 17282 raft_consensus.cc:1261] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 FOLLOWER]: Refusing update from remote peer 34639c83c971438f9197057234b1b85b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:12.093221 17365 consensus_queue.cc:1035] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:12.093482 17368 consensus_queue.cc:1035] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:12.100907 17371 mvcc.cc:205] Tried to move back new op lower bound from 7316981318003355648 to 7316981317884035072. Current Snapshot: MvccSnapshot[applied={T|T < 7316981318003355648}]
I20260810 14:33:12.110128 16816 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:12.110347 16816 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:12.113085 16816 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Sending DeleteTablet for 3 replicas of tablet 9064ec03376d4659997914da40000dc8
I20260810 14:33:12.114018 17259 tablet_service.cc:1514] Processing DeleteTablet for tablet 9064ec03376d4659997914da40000dc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:12 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:46398
I20260810 14:33:12.114014 16952 tablet_service.cc:1514] Processing DeleteTablet for tablet 9064ec03376d4659997914da40000dc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:12 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:48352
I20260810 14:33:12.114307 17104 tablet_service.cc:1514] Processing DeleteTablet for tablet 9064ec03376d4659997914da40000dc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:12 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:52440
I20260810 14:33:12.114636 17383 tablet_replica.cc:330] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: stopping tablet replica
I20260810 14:33:12.114902 17384 tablet_replica.cc:330] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: stopping tablet replica
I20260810 14:33:12.115041 17385 tablet_replica.cc:330] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: stopping tablet replica
I20260810 14:33:12.115442 17384 raft_consensus.cc:2229] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:33:12.115486 17385 raft_consensus.cc:2229] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:12.115799 17383 raft_consensus.cc:2229] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:12.115927 17385 raft_consensus.cc:2258] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:12.115988 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 16884
I20260810 14:33:12.116406 17384 raft_consensus.cc:2258] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:12.117549 17383 raft_consensus.cc:2258] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:12.119186 17383 ts_tablet_manager.cc:1905] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:12.121326 17385 ts_tablet_manager.cc:1905] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:12.121768 17383 ts_tablet_manager.cc:1918] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:12.121891 17383 log.cc:1196] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/9064ec03376d4659997914da40000dc8
I20260810 14:33:12.122222 17383 ts_tablet_manager.cc:1939] T 9064ec03376d4659997914da40000dc8 P 4f4ee927ae7e49deb02c1929f1f3e417: Deleting consensus metadata
I20260810 14:33:12.123420 16796 catalog_manager.cc:4841] TS 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645): tablet 9064ec03376d4659997914da40000dc8 (table test-table [id=b04eb23b6bce4dbcaa3f7d97f46779dc]) successfully deleted
I20260810 14:33:12.124923 17385 ts_tablet_manager.cc:1918] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:12.125041 17385 log.cc:1196] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/9064ec03376d4659997914da40000dc8
I20260810 14:33:12.125392 17385 ts_tablet_manager.cc:1939] T 9064ec03376d4659997914da40000dc8 P 83a7f100e3034601922178b324bd9c92: Deleting consensus metadata
W20260810 14:33:12.126431 16801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:45421 (error 108)
I20260810 14:33:12.126713 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 17035
I20260810 14:33:12.126713 16798 catalog_manager.cc:4841] TS 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541): tablet 9064ec03376d4659997914da40000dc8 (table test-table [id=b04eb23b6bce4dbcaa3f7d97f46779dc]) successfully deleted
I20260810 14:33:12.130033 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.129744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45421 (local address 127.0.0.1:48372)
0810 14:33:12.129885 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:12.129959 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:45421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 14:33:12.130247 16801 catalog_manager.cc:4584] TS 34639c83c971438f9197057234b1b85b (127.1.206.65:45421): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9064ec03376d4659997914da40000dc8: Network error: Client connection negotiation failed: client connection to 127.1.206.65:45421: connect: Connection refused (error 111)
I20260810 14:33:12.135066 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 17188
I20260810 14:33:12.142880 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 16779
I20260810 14:33:12.152073 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43381
--webserver_interface=127.1.206.126
--webserver_port=40549
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:43381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:12.269940 17387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:12.270246 17387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:12.270292 17387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:12.274638 17387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:12.274719 17387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:12.274739 17387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:12.274757 17387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:12.274813 17387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:12.280612 17387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:43381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=40549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:12.281853 17387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:12.282946 17387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:12.298110 17398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:12.298117 17396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:12.298224 17387 server_base.cc:1034] running on GCE node
W20260810 14:33:12.298110 17395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:12.299156 17387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:12.300554 17387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:12.301724 17387 hybrid_clock.cc:648] HybridClock initialized: now 1786372392301710 us; error 30 us; skew 500 ppm
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:12.304726 17387 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:12.305696 17387 webserver.cc:460] Webserver started at http://127.1.206.126:40549/ using document root <none> and password file <none>
I20260810 14:33:12.306331 17387 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:12.306470 17387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:12.310704 17387 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 14:33:12.313082 17405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.314479 17387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:33:12.314664 17387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "9d7d637883f8455e8365ae7203da45cd"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3f4ad2c882a23c291da838d67f8e0b00"
server_key_iv: "58a393a9d4e3f49e551a74647e1be7eb"
server_key_version: "encryptionkey@0"
I20260810 14:33:12.315374 17387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:12.346029 17387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:12.349097 17387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:12.349341 17387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:12.356750 17387 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:43381
I20260810 14:33:12.357059 17464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:43381 every 8 connection(s)
I20260810 14:33:12.357909 17387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:12.360108 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 17387
I20260810 14:33:12.360648 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:45421
--local_ip_for_outbound_sockets=127.1.206.65
--tserver_master_addrs=127.1.206.126:43381
--webserver_port=39393
--webserver_interface=127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:12.363258 17465 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:33:12.365159 17465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Bootstrap starting.
I20260810 14:33:12.383100 17465 log.cc:824] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:12.392035 17465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:33:12.392513 17465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Bootstrap complete.
I20260810 14:33:12.396809 17465 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:12.397220 17465 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d7d637883f8455e8365ae7203da45cd, State: Initialized, Role: FOLLOWER
I20260810 14:33:12.397706 17465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:12.397830 17465 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:33:12.397929 17465 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:33:12.398047 17465 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:33:12.399982 17465 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:12.400373 17465 leader_election.cc:302] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d7d637883f8455e8365ae7203da45cd; no voters:
I20260810 14:33:12.400729 17465 leader_election.cc:288] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:33:12.400822 17469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:33:12.401031 17469 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 LEADER]: Becoming Leader. State: Replica: 9d7d637883f8455e8365ae7203da45cd, State: Running, Role: LEADER
I20260810 14:33:12.401331 17469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:12.402007 17465 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:12.402262 17469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d7d637883f8455e8365ae7203da45cd. Latest consensus state: current_term: 2 leader_uuid: "9d7d637883f8455e8365ae7203da45cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } } }
I20260810 14:33:12.402392 17469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:12.402752 17473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:12.402765 17470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9d7d637883f8455e8365ae7203da45cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } } }
I20260810 14:33:12.403025 17470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:12.407933 17473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:12.408653 17473 catalog_manager.cc:1259] Loaded cluster ID: 6f908915a6db40f5b42a010270246f1d
I20260810 14:33:12.408732 17473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:33:12.410204 17473 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 14:33:12.415138 17473 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 14:33:12.421518 17473 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:33:12.422443 17473 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Loaded TSK: 0
I20260810 14:33:12.423663 17473 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:33:12.483170 17467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:12.483520 17467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:12.483618 17467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:12.487950 17467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:12.488057 17467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:12.488148 17467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:33:12.493817 17467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:45421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=39393
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:12.494911 17467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:12.495952 17467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:12.506958 17500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:12.507021 17503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:12.507007 17501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:12.507447 17467 server_base.cc:1034] running on GCE node
I20260810 14:33:12.507961 17467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:12.508827 17467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:12.510040 17467 hybrid_clock.cc:648] HybridClock initialized: now 1786372392509996 us; error 53 us; skew 500 ppm
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:12.513656 17467 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:33:12.514753 17467 webserver.cc:460] Webserver started at http://127.1.206.65:39393/ using document root <none> and password file <none>
I20260810 14:33:12.515338 17467 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:12.515419 17467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:12.519929 17467 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:33:12.522400 17510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.523794 17467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 14:33:12.523926 17467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "34639c83c971438f9197057234b1b85b"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3fca74e2733d85e2f23c82ef8a29a651"
server_key_iv: "4ce69de6ec9d77b1da3543d75ea8836c"
server_key_version: "encryptionkey@0"
I20260810 14:33:12.524561 17467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:12.538466 17467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:12.541791 17467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:12.542006 17467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:12.542687 17467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:12.543857 17518 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:33:12.549818 17467 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:33:12.549938 17467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260810 14:33:12.550031 17467 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:33:12.551855 17467 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:33:12.551939 17467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 14:33:12.552211 17518 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Bootstrap starting.
I20260810 14:33:12.563647 17467 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:45421
I20260810 14:33:12.563737 17638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:45421 every 8 connection(s)
I20260810 14:33:12.564845 17467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:33:12.568928 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 17467
I20260810 14:33:12.569384 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:46541
--local_ip_for_outbound_sockets=127.1.206.66
--tserver_master_addrs=127.1.206.126:43381
--webserver_port=45113
--webserver_interface=127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:12.573041 17518 log.cc:824] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:12.583873 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.567129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:38007 (local address 127.1.206.126:43381)
0810 14:33:12.567612 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.567637 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.567906 (+ 269us) server_negotiation.cc:407] Connection header received
0810 14:33:12.569384 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.569400 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.569834 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.570264 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:12.571785 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.572866 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.574527 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.575159 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.575362 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.578115 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:12.578120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:12.578133 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:12.578168 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:12.580154 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.580874 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.580880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.580885 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.581029 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.581456 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.581459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.581460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.581868 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:12.582028 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.582606 (+ 578us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.583195 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":147,"threads_started":1}
I20260810 14:33:12.583899 17643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.567045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:38007)
0810 14:33:12.567704 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:12.567763 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:12.568748 (+ 985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.570355 (+ 1607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.570367 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.570915 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:12.571573 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.571591 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.573042 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.573045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.574389 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.574400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.575323 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.575329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.575572 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.576218 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:12.576234 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:12.577876 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:12.580360 (+ 2484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.580367 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.580382 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.580702 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.581147 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.581150 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.581152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.581329 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.581999 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:12.582006 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:12.582277 (+ 271us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.582466 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.582840 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":162,"threads_started":1}
I20260810 14:33:12.583967 17518 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:33:12.584864 17518 tablet_bootstrap.cc:492] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Bootstrap complete.
I20260810 14:33:12.586251 17518 ts_tablet_manager.cc:1397] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Time spent bootstrapping tablet: real 0.034s user 0.020s sys 0.011s
I20260810 14:33:12.587081 17639 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43381
I20260810 14:33:12.587324 17639 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:12.587880 17639 heartbeater.cc:511] Master 127.1.206.126:43381 requested a full tablet report, sending...
I20260810 14:33:12.589277 17518 raft_consensus.cc:348] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.589809 17518 raft_consensus.cc:729] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34639c83c971438f9197057234b1b85b, State: Initialized, Role: FOLLOWER
I20260810 14:33:12.590188 17518 consensus_queue.cc:260] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } }
I20260810 14:33:12.590838 17424 ts_manager.cc:194] Registered new tserver with Master: 34639c83c971438f9197057234b1b85b (127.1.206.65:45421)
I20260810 14:33:12.590998 17518 ts_tablet_manager.cc:1428] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260810 14:33:12.594949 17424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:38007
I20260810 14:33:12.597772 17639 heartbeater.cc:503] Master 127.1.206.126:43381 was elected leader, sending a full tablet report...
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:33:12.606709 17648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.594466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48386 (local address 127.1.206.65:45421)
0810 14:33:12.594946 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.594958 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.595365 (+ 407us) server_negotiation.cc:407] Connection header received
0810 14:33:12.595607 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.595613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.595774 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.595944 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:12.596747 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.597766 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.599854 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.600223 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.600383 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.602948 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:12.602958 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:12.602969 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:12.602994 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:12.604750 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.605326 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.605335 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.605337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.605426 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.605715 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.605717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.605719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.605951 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:12.606052 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.606436 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.606576 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":155,"threads_started":1}
I20260810 14:33:12.606743 17647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.594456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45421 (local address 127.0.0.1:48386)
0810 14:33:12.595206 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:12.595261 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:12.595442 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.595971 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.595977 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.596471 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:12.596606 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.596614 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.597901 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.597904 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.599722 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.599734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.600415 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.600419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.600531 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.601171 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:12.601186 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:12.602784 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:12.604867 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.604877 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.604882 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.605183 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.605521 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.605524 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.605526 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.605626 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.606061 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:12.606066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:12.606207 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.606364 (+ 157us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.606571 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":151,"threads_started":1}
I20260810 14:33:12.607858 17563 tablet_service.cc:1514] Processing DeleteTablet for tablet 9064ec03376d4659997914da40000dc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:12 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:48386
I20260810 14:33:12.608834 17649 tablet_replica.cc:330] stopping tablet replica
I20260810 14:33:12.609160 17649 raft_consensus.cc:2229] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:12.609433 17649 raft_consensus.cc:2258] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:12.610787 17649 ts_tablet_manager.cc:1905] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:12.615628 17649 ts_tablet_manager.cc:1918] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:12.615747 17649 log.cc:1196] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/9064ec03376d4659997914da40000dc8
I20260810 14:33:12.616029 17649 ts_tablet_manager.cc:1939] T 9064ec03376d4659997914da40000dc8 P 34639c83c971438f9197057234b1b85b: Deleting consensus metadata
I20260810 14:33:12.618172 17409 catalog_manager.cc:4841] TS 34639c83c971438f9197057234b1b85b (127.1.206.65:45421): tablet 9064ec03376d4659997914da40000dc8 (table test-table [id=b04eb23b6bce4dbcaa3f7d97f46779dc]) successfully deleted
W20260810 14:33:12.697611 17644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:12.697894 17644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:12.697939 17644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:12.701985 17644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:12.702069 17644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:12.702158 17644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:33:12.707950 17644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:46541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=45113
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:12.709110 17644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:12.710155 17644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:12.719842 17656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:12.720045 17644 server_base.cc:1034] running on GCE node
W20260810 14:33:12.719848 17655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:12.719848 17658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:12.720794 17644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:12.721424 17644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:12.722591 17644 hybrid_clock.cc:648] HybridClock initialized: now 1786372392722571 us; error 30 us; skew 500 ppm
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:12.725471 17644 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:33:12.726372 17644 webserver.cc:460] Webserver started at http://127.1.206.66:45113/ using document root <none> and password file <none>
I20260810 14:33:12.726902 17644 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:12.726972 17644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:12.730911 17644 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:33:12.732933 17667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.734125 17644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:33:12.734283 17644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "83a7f100e3034601922178b324bd9c92"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "0de8bad7fb5132bcdd46488a7c1c12f2"
server_key_iv: "95222866e0056f63dd3074331a0beefe"
server_key_version: "encryptionkey@0"
I20260810 14:33:12.734825 17644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:12.746990 17644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:12.750633 17644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:12.750883 17644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:12.751609 17644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:12.752568 17644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:12.752620 17644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.752663 17644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:12.752720 17644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.762351 17644 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:46541
I20260810 14:33:12.762387 17797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:46541 every 8 connection(s)
I20260810 14:33:12.763505 17644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:33:12.768218 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 17644
I20260810 14:33:12.768769 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:38645
--local_ip_for_outbound_sockets=127.1.206.67
--tserver_master_addrs=127.1.206.126:43381
--webserver_port=36287
--webserver_interface=127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:12.781840 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.765571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:50297 (local address 127.1.206.126:43381)
0810 14:33:12.765785 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.765790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.767176 (+ 1386us) server_negotiation.cc:407] Connection header received
0810 14:33:12.768180 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.768184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.768282 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.768398 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:12.770276 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.771098 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.772935 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.773398 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.773533 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.776693 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:12.776700 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:12.776707 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:12.776752 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:12.778955 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.779717 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.779723 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.779727 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.779843 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.780317 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.780322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.780324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.780629 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:12.780759 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.781368 (+ 609us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.781574 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260810 14:33:12.782811 17800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.765977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:50297)
0810 14:33:12.766949 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:12.766999 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:12.767939 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.768657 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.768669 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.769231 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:12.770022 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.770047 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.771267 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.771271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.772790 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.772801 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.773593 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.773596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.773779 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.774548 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:12.774567 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:12.776463 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:12.779166 (+ 2703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.779187 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.779206 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.779584 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.779968 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.779970 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.779972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.780170 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.780750 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:12.780757 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:12.781045 (+ 288us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.781227 (+ 182us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.781684 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"thread_start_us":586,"threads_started":1}
I20260810 14:33:12.784294 17798 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43381
I20260810 14:33:12.784601 17798 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:12.785247 17798 heartbeater.cc:511] Master 127.1.206.126:43381 requested a full tablet report, sending...
I20260810 14:33:12.786566 17424 ts_manager.cc:194] Registered new tserver with Master: 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
I20260810 14:33:12.787204 17424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:50297
W20260810 14:33:12.892436 17801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:12.892784 17801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:12.892866 17801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:12.897007 17801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:12.897113 17801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:12.897222 17801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:33:12.902958 17801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:38645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=36287
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:12.904127 17801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:12.905231 17801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:12.915513 17811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:12.915531 17809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:12.915781 17801 server_base.cc:1034] running on GCE node
W20260810 14:33:12.915513 17808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:12.916401 17801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:12.917098 17801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:12.918298 17801 hybrid_clock.cc:648] HybridClock initialized: now 1786372392918276 us; error 32 us; skew 500 ppm
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:12.921393 17801 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:33:12.922278 17801 webserver.cc:460] Webserver started at http://127.1.206.67:36287/ using document root <none> and password file <none>
I20260810 14:33:12.922858 17801 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:12.922941 17801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:12.927136 17801 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:33:12.929507 17818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.930941 17801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:33:12.931072 17801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "4f4ee927ae7e49deb02c1929f1f3e417"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "723fcf9077f19b533616b98e307f5f23"
server_key_iv: "e1ac390b13efbaf67cdfba2762067059"
server_key_version: "encryptionkey@0"
I20260810 14:33:12.931646 17801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:12.948465 17801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:12.951650 17801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:12.951876 17801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:12.952556 17801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:12.953410 17801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:12.953459 17801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.953526 17801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:12.953567 17801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:12.963449 17801 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:38645
I20260810 14:33:12.963471 17952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:38645 every 8 connection(s)
I20260810 14:33:12.964587 17801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:33:12.968189 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 17801
Aug 10 14:33:12 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372392, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:12.977532 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.968899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.1.206.126:43381)
0810 14:33:12.969194 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.969198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.969291 (+ 93us) server_negotiation.cc:407] Connection header received
0810 14:33:12.969403 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.969406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.969451 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.969547 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:12.970270 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.970914 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.971824 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.972159 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.972306 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.973917 (+ 1611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:12.973922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:12.973925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:12.973952 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:12.975523 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.976069 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.976074 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.976078 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.976218 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.976569 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.976572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.976574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.976846 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:12.977063 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.977212 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.977357 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":228,"thread_start_us":66,"threads_started":1}
I20260810 14:33:12.979655 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.966494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:47805 (local address 127.1.206.126:43381)
0810 14:33:12.966649 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.966654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.967839 (+ 1185us) server_negotiation.cc:407] Connection header received
0810 14:33:12.968832 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.968836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.968896 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.968985 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:12.970434 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.970983 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.972298 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.972627 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.972731 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.975566 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:12.975569 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:12.975571 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:12.975593 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:12.977253 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.978047 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.978050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.978052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.978142 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:12.978509 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:12.978513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:12.978515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:12.978700 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:12.978821 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.979365 (+ 544us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.979494 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":56}
I20260810 14:33:12.980612 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.966987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:47805)
0810 14:33:12.967662 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:12.967706 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:12.968596 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:12.969166 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:12.969175 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:12.969744 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:12.970275 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.970293 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.971114 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.971117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.972155 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:12.972165 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.972801 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.972806 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:12.973036 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.973652 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:12.973698 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:12.975388 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:12.977509 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.977516 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.977530 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.977930 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.978238 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:12.978242 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:12.978244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:12.978406 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:12.978821 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:12.978828 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:12.979097 (+ 269us) client_negotiation.cc:769] Sending connection context
0810 14:33:12.979311 (+ 214us) client_negotiation.cc:240] Negotiation successful
0810 14:33:12.979673 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":118,"threads_started":1}
I20260810 14:33:12.981812 17953 heartbeater.cc:347] Connected to a master server at 127.1.206.126:43381
I20260810 14:33:12.982054 17953 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:12.982530 17953 heartbeater.cc:511] Master 127.1.206.126:43381 requested a full tablet report, sending...
I20260810 14:33:12.983551 17424 ts_manager.cc:194] Registered new tserver with Master: 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645)
I20260810 14:33:12.984154 17424 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:47805
I20260810 14:33:12.991264 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:33:12.995575 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:12.991928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36620 (local address 127.1.206.126:43381)
0810 14:33:12.992063 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:12.992067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:12.992356 (+ 289us) server_negotiation.cc:407] Connection header received
0810 14:33:12.992536 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:12.992538 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:12.992647 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:12.992741 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:33:12.992964 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.993471 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.994292 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:12.994501 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:12.994579 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:12.994851 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:33:12.995258 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:33:12.995353 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:12.995418 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 14:33:12.995466 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 14:33:12.996311 17424 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:36620:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:33:12.999605 17424 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:33:13.008392 17563 tablet_service.cc:1467] Processing CreateTablet for tablet 732b77ea8e8d4e16bc9bb590acf27d8d (DEFAULT_TABLE table=test-table [id=06c25f406c8e4005a297bc4bafde12df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:13.009140 17563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732b77ea8e8d4e16bc9bb590acf27d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:13.012063 17518 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Bootstrap starting.
I20260810 14:33:13.012835 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.007414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46541 (local address 127.0.0.1:52456)
0810 14:33:13.007782 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.007798 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:13.007900 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:13.008526 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:13.008529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:13.008548 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:13.008707 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.008714 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.009840 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.009844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.010938 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.010949 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.012348 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.012354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.012461 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.012514 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 14:33:13.012590 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:33:13.012674 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":27,"thread_start_us":129,"threads_started":1}
I20260810 14:33:13.013088 17518 tablet_bootstrap.cc:654] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:13.013226 17647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.006996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38645 (local address 127.0.0.1:46408)
0810 14:33:13.007118 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.007134 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:13.007212 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:13.008544 (+ 1332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:13.008547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:13.008568 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:13.008698 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.008705 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.010352 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.010355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.011330 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.011338 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.012802 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.012805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.012918 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.012946 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 14:33:13.013022 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:33:13.013107 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":5}
I20260810 14:33:13.013337 17964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.007595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52456 (local address 127.1.206.66:46541)
0810 14:33:13.007937 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:13.007952 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:13.008014 (+ 62us) server_negotiation.cc:407] Connection header received
0810 14:33:13.008119 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:13.008125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:13.008369 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:13.008546 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:13.008835 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.009696 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.011084 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.011964 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.012079 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.012243 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:13.013074 (+ 831us) server_negotiation.cc:299] Negotiation successful
0810 14:33:13.013176 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":114,"threads_started":1}
I20260810 14:33:13.013651 17963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.007414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46408 (local address 127.1.206.67:38645)
0810 14:33:13.008024 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:13.008037 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:13.008060 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:33:13.008134 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:13.008140 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:13.008372 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:13.008990 (+ 618us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:13.009149 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.010187 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.011453 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.012084 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.012329 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.012488 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:13.013400 (+ 912us) server_negotiation.cc:299] Negotiation successful
0810 14:33:13.013515 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":140,"threads_started":1}
I20260810 14:33:13.016115 17877 tablet_service.cc:1467] Processing CreateTablet for tablet 732b77ea8e8d4e16bc9bb590acf27d8d (DEFAULT_TABLE table=test-table [id=06c25f406c8e4005a297bc4bafde12df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:13.016108 17717 tablet_service.cc:1467] Processing CreateTablet for tablet 732b77ea8e8d4e16bc9bb590acf27d8d (DEFAULT_TABLE table=test-table [id=06c25f406c8e4005a297bc4bafde12df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:13.017251 17717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732b77ea8e8d4e16bc9bb590acf27d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:13.017266 17877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732b77ea8e8d4e16bc9bb590acf27d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:13.017611 17518 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: No bootstrap required, opened a new log
I20260810 14:33:13.017721 17518 ts_tablet_manager.cc:1397] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260810 14:33:13.018216 17518 raft_consensus.cc:348] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.018360 17518 raft_consensus.cc:374] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:13.018404 17518 raft_consensus.cc:729] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34639c83c971438f9197057234b1b85b, State: Initialized, Role: FOLLOWER
I20260810 14:33:13.018568 17518 consensus_queue.cc:260] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.019387 17518 ts_tablet_manager.cc:1428] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:33:13.025332 17966 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Bootstrap starting.
I20260810 14:33:13.027791 17966 tablet_bootstrap.cc:654] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:13.027840 17967 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Bootstrap starting.
I20260810 14:33:13.028718 17966 log.cc:824] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:13.030186 17967 tablet_bootstrap.cc:654] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:13.030850 17966 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: No bootstrap required, opened a new log
I20260810 14:33:13.031072 17966 ts_tablet_manager.cc:1397] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:33:13.031082 17967 log.cc:824] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:13.033053 17967 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: No bootstrap required, opened a new log
I20260810 14:33:13.033262 17967 ts_tablet_manager.cc:1397] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:33:13.034397 17966 raft_consensus.cc:348] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.034626 17966 raft_consensus.cc:374] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:13.034698 17966 raft_consensus.cc:729] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f4ee927ae7e49deb02c1929f1f3e417, State: Initialized, Role: FOLLOWER
I20260810 14:33:13.035141 17966 consensus_queue.cc:260] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.035861 17953 heartbeater.cc:503] Master 127.1.206.126:43381 was elected leader, sending a full tablet report...
I20260810 14:33:13.036356 17966 ts_tablet_manager.cc:1428] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260810 14:33:13.036672 17967 raft_consensus.cc:348] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.036974 17967 raft_consensus.cc:374] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:13.037027 17967 raft_consensus.cc:729] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83a7f100e3034601922178b324bd9c92, State: Initialized, Role: FOLLOWER
I20260810 14:33:13.037457 17967 consensus_queue.cc:260] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.038496 17967 ts_tablet_manager.cc:1428] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 14:33:13.039398 17798 heartbeater.cc:503] Master 127.1.206.126:43381 was elected leader, sending a full tablet report...
W20260810 14:33:13.066234 17640 tablet.cc:2369] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:13.167661 17971 raft_consensus.cc:482] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:13.167908 17971 raft_consensus.cc:504] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.169297 17971 leader_election.cc:288] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541), 34639c83c971438f9197057234b1b85b (127.1.206.65:45421)
I20260810 14:33:13.173079 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.169478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46541 (local address 127.1.206.67:54897)
0810 14:33:13.169645 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.169665 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:13.169765 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:13.170143 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:13.170146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:13.170197 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:13.170309 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.170314 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.171065 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.171071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.171898 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.171908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.172624 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.172628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.172743 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.172760 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 14:33:13.172854 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 14:33:13.172932 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":21,"spinlock_wait_cycles":18176}
I20260810 14:33:13.173079 17964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.169731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:54897 (local address 127.1.206.66:46541)
0810 14:33:13.169875 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:13.169879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:13.169895 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:33:13.169952 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:13.169956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:13.170008 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:13.170098 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:13.170435 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.170945 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.172040 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.172486 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.172623 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.172679 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:13.172872 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 14:33:13.172946 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:33:13.173465 17973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.169613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45421 (local address 127.1.206.67:35993)
0810 14:33:13.170037 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.170049 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:13.170211 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:13.170536 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:13.170539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:13.170556 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:13.170678 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.170684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.171440 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.171445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.172301 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:13.172315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.173026 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.173029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:13.173119 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.173139 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 14:33:13.173199 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 14:33:13.173267 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":3,"spinlock_wait_cycles":32384,"thread_start_us":129,"threads_started":1}
I20260810 14:33:13.173480 17974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.169734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:35993 (local address 127.1.206.65:45421)
0810 14:33:13.170010 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:13.170014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:13.170144 (+ 130us) server_negotiation.cc:407] Connection header received
0810 14:33:13.170344 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:13.170346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:13.170403 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:13.170527 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:13.170801 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.171317 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.172436 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.172892 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.173027 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.173199 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:13.173236 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 14:33:13.173314 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":89,"threads_started":1}
I20260810 14:33:13.174080 17743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732b77ea8e8d4e16bc9bb590acf27d8d" candidate_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a7f100e3034601922178b324bd9c92" is_pre_election: true
I20260810 14:33:13.174062 17565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732b77ea8e8d4e16bc9bb590acf27d8d" candidate_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34639c83c971438f9197057234b1b85b" is_pre_election: true
I20260810 14:33:13.174407 17743 raft_consensus.cc:2454] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f4ee927ae7e49deb02c1929f1f3e417 in term 0.
I20260810 14:33:13.174410 17565 raft_consensus.cc:2454] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f4ee927ae7e49deb02c1929f1f3e417 in term 0.
I20260810 14:33:13.174991 17823 leader_election.cc:302] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 34639c83c971438f9197057234b1b85b, 4f4ee927ae7e49deb02c1929f1f3e417, 83a7f100e3034601922178b324bd9c92; no voters:
I20260810 14:33:13.175314 17971 raft_consensus.cc:2781] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:33:13.175426 17971 raft_consensus.cc:482] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:33:13.175473 17971 raft_consensus.cc:3037] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:13.176616 17971 raft_consensus.cc:504] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.177019 17971 leader_election.cc:288] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [CANDIDATE]: Term 1 election: Requested vote from peers 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541), 34639c83c971438f9197057234b1b85b (127.1.206.65:45421)
I20260810 14:33:13.177453 17743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732b77ea8e8d4e16bc9bb590acf27d8d" candidate_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83a7f100e3034601922178b324bd9c92"
I20260810 14:33:13.177457 17565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732b77ea8e8d4e16bc9bb590acf27d8d" candidate_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34639c83c971438f9197057234b1b85b"
I20260810 14:33:13.177608 17743 raft_consensus.cc:3037] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:13.177630 17565 raft_consensus.cc:3037] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:13.178733 17743 raft_consensus.cc:2454] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f4ee927ae7e49deb02c1929f1f3e417 in term 1.
I20260810 14:33:13.178743 17565 raft_consensus.cc:2454] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f4ee927ae7e49deb02c1929f1f3e417 in term 1.
I20260810 14:33:13.179129 17824 leader_election.cc:302] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34639c83c971438f9197057234b1b85b, 4f4ee927ae7e49deb02c1929f1f3e417; no voters:
I20260810 14:33:13.179343 17971 raft_consensus.cc:2781] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:13.179648 17971 raft_consensus.cc:686] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 LEADER]: Becoming Leader. State: Replica: 4f4ee927ae7e49deb02c1929f1f3e417, State: Running, Role: LEADER
I20260810 14:33:13.180055 17971 consensus_queue.cc:237] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.183575 17424 catalog_manager.cc:5495] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67). New cstate: current_term: 1 leader_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } health_report { overall_health: UNKNOWN } } }
W20260810 14:33:13.215667 17954 tablet.cc:2369] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:13.217911 17963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.213019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46416 (local address 127.1.206.67:38645)
0810 14:33:13.213185 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:13.213192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:13.213214 (+ 22us) server_negotiation.cc:407] Connection header received
0810 14:33:13.213335 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:13.213340 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:13.213428 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:13.213561 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:33:13.213941 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.214855 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.216021 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:13.216471 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:13.216597 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:13.216977 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:33:13.217393 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:33:13.217494 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:13.217636 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 14:33:13.217719 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 14:33:13.224835 17743 raft_consensus.cc:1261] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Refusing update from remote peer 4f4ee927ae7e49deb02c1929f1f3e417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:13.224833 17565 raft_consensus.cc:1261] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Refusing update from remote peer 4f4ee927ae7e49deb02c1929f1f3e417: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:13.225682 17971 consensus_queue.cc:1035] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:13.225945 17975 consensus_queue.cc:1035] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:13.232841 17980 mvcc.cc:205] Tried to move back new op lower bound from 7316981322641027072 to 7316981322468855808. Current Snapshot: MvccSnapshot[applied={T|T < 7316981322641027072}]
I20260810 14:33:13.232481 17978 mvcc.cc:205] Tried to move back new op lower bound from 7316981322641027072 to 7316981322468855808. Current Snapshot: MvccSnapshot[applied={T|T < 7316981322641027072}]
I20260810 14:33:13.241835 17424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:36620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:13.241997 17424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:36620:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:13.244403 17424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Sending DeleteTablet for 3 replicas of tablet 732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:13.245163 17877 tablet_service.cc:1514] Processing DeleteTablet for tablet 732b77ea8e8d4e16bc9bb590acf27d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:13 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:46408
I20260810 14:33:13.245273 17563 tablet_service.cc:1514] Processing DeleteTablet for tablet 732b77ea8e8d4e16bc9bb590acf27d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:13 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:48386
I20260810 14:33:13.245384 17717 tablet_service.cc:1514] Processing DeleteTablet for tablet 732b77ea8e8d4e16bc9bb590acf27d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:13 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:52456
I20260810 14:33:13.245816 17992 tablet_replica.cc:330] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: stopping tablet replica
I20260810 14:33:13.245929 17993 tablet_replica.cc:330] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: stopping tablet replica
I20260810 14:33:13.246189 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 17467
I20260810 14:33:13.246357 17992 raft_consensus.cc:2229] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:33:13.247666 17992 raft_consensus.cc:2258] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:13.247702 17993 raft_consensus.cc:2229] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:13.248149 17993 raft_consensus.cc:2258] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:13.249848 17992 ts_tablet_manager.cc:1905] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:13.250113 17993 ts_tablet_manager.cc:1905] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:13.252952 17992 ts_tablet_manager.cc:1918] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:13.253147 17992 log.cc:1196] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:13.253583 17992 ts_tablet_manager.cc:1939] T 732b77ea8e8d4e16bc9bb590acf27d8d P 4f4ee927ae7e49deb02c1929f1f3e417: Deleting consensus metadata
I20260810 14:33:13.253697 17993 ts_tablet_manager.cc:1918] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:13.253829 17993 log.cc:1196] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:13.254170 17993 ts_tablet_manager.cc:1939] T 732b77ea8e8d4e16bc9bb590acf27d8d P 83a7f100e3034601922178b324bd9c92: Deleting consensus metadata
I20260810 14:33:13.255204 17406 catalog_manager.cc:4841] TS 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645): tablet 732b77ea8e8d4e16bc9bb590acf27d8d (table test-table [id=06c25f406c8e4005a297bc4bafde12df]) successfully deleted
I20260810 14:33:13.255475 17408 catalog_manager.cc:4841] TS 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541): tablet 732b77ea8e8d4e16bc9bb590acf27d8d (table test-table [id=06c25f406c8e4005a297bc4bafde12df]) successfully deleted
W20260810 14:33:13.258258 17409 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:45421 (error 108)
I20260810 14:33:13.258880 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 17644
I20260810 14:33:13.261705 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.259130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:45421 (local address 127.0.0.1:48390)
0810 14:33:13.261493 (+ 2363us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.261591 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:45421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2241}
W20260810 14:33:13.262915 17409 catalog_manager.cc:4584] TS 34639c83c971438f9197057234b1b85b (127.1.206.65:45421): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 732b77ea8e8d4e16bc9bb590acf27d8d: Network error: Client connection negotiation failed: client connection to 127.1.206.65:45421: connect: Connection refused (error 111)
I20260810 14:33:13.270328 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 17801
I20260810 14:33:13.278437 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 17387
I20260810 14:33:13.287612 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43381
--webserver_interface=127.1.206.126
--webserver_port=40549
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:43381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:13.404668 17995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:13.404987 17995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:13.405031 17995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:13.409482 17995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:13.409567 17995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:13.409590 17995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:13.409607 17995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:13.409657 17995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:13.415457 17995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:43381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:43381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=40549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:13.416782 17995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:13.417941 17995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:13.426990 18005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:13.427009 18002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:13.427194 17995 server_base.cc:1034] running on GCE node
W20260810 14:33:13.427027 18001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:13.427995 17995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:13.429282 17995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:13.430482 17995 hybrid_clock.cc:648] HybridClock initialized: now 1786372393430474 us; error 32 us; skew 500 ppm
Aug 10 14:33:13 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372393, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:13.433584 17995 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:13.434636 17995 webserver.cc:460] Webserver started at http://127.1.206.126:40549/ using document root <none> and password file <none>
I20260810 14:33:13.435235 17995 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:13.435334 17995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:13.439415 17995 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:33:13.441710 18016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:13.442926 17995 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:33:13.443079 17995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "9d7d637883f8455e8365ae7203da45cd"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3f4ad2c882a23c291da838d67f8e0b00"
server_key_iv: "58a393a9d4e3f49e551a74647e1be7eb"
server_key_version: "encryptionkey@0"
I20260810 14:33:13.443670 17995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:13.465225 17995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:13.469184 17995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:13.469410 17995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:13.477126 17995 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:43381
I20260810 14:33:13.477415 18072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:43381 every 8 connection(s)
I20260810 14:33:13.478317 17995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:13.483038 18074 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:33:13.485091 18074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Bootstrap starting.
I20260810 14:33:13.485378 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 17995
I20260810 14:33:13.485832 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:45421
--local_ip_for_outbound_sockets=127.1.206.65
--tserver_master_addrs=127.1.206.126:43381
--webserver_port=39393
--webserver_interface=127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:13.503502 18074 log.cc:824] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:13.515108 18074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:33:13.515548 18074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd: Bootstrap complete.
I20260810 14:33:13.519795 18074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:13.520213 18074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d7d637883f8455e8365ae7203da45cd, State: Initialized, Role: FOLLOWER
I20260810 14:33:13.520810 18074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:13.520977 18074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:33:13.521054 18074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:33:13.521153 18074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 2 FOLLOWER]: Advancing to term 3
I20260810 14:33:13.523123 18074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:13.523480 18074 leader_election.cc:302] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d7d637883f8455e8365ae7203da45cd; no voters:
I20260810 14:33:13.523829 18074 leader_election.cc:288] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 14:33:13.523926 18079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 3 FOLLOWER]: Leader election won for term 3
I20260810 14:33:13.524149 18079 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [term 3 LEADER]: Becoming Leader. State: Replica: 9d7d637883f8455e8365ae7203da45cd, State: Running, Role: LEADER
I20260810 14:33:13.524462 18079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } }
I20260810 14:33:13.525113 18074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:13.525846 18081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9d7d637883f8455e8365ae7203da45cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } } }
I20260810 14:33:13.526000 18081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:13.526618 18082 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d7d637883f8455e8365ae7203da45cd. Latest consensus state: current_term: 3 leader_uuid: "9d7d637883f8455e8365ae7203da45cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d7d637883f8455e8365ae7203da45cd" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 43381 } } }
I20260810 14:33:13.526772 18082 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d7d637883f8455e8365ae7203da45cd [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:13.527042 18090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:13.532646 18090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:13.533550 18090 catalog_manager.cc:1259] Loaded cluster ID: 6f908915a6db40f5b42a010270246f1d
I20260810 14:33:13.533620 18090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 14:33:13.535336 18090 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2dd8b3a9ad google::LogMessage::Fail() at ??:0
@ 0x7f2dd8b3d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f2dd8b3a4de google::LogMessage::Flush() at ??:0
@ 0x7f2dd8b3ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2de3479fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f2de347ad2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2de3477579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f2de34bb640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2ddad8c3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2ddad8cc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f2ddad8e3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2ddad7d512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2ddc3c16db start_thread at ??:0
@ 0x7f2dd763861f clone at ??:0
W20260810 14:33:13.636654 18077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:13.637079 18077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:13.637151 18077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:13.643594 18077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:13.643694 18077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:13.643790 18077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:33:13.652185 18077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:45421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=39393
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:13.653723 18077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:13.655143 18077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:13.667888 18123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:13.667889 18124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:13.667888 18126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:13.668440 18077 server_base.cc:1034] running on GCE node
I20260810 14:33:13.668897 18077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:13.669627 18077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:13.670840 18077 hybrid_clock.cc:648] HybridClock initialized: now 1786372393670805 us; error 49 us; skew 500 ppm
Aug 10 14:33:13 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372393, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:13.674032 18077 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:33:13.675128 18077 webserver.cc:460] Webserver started at http://127.1.206.65:39393/ using document root <none> and password file <none>
I20260810 14:33:13.675783 18077 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:13.675882 18077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:13.680419 18077 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 14:33:13.682971 18133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:13.684566 18077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:13.684703 18077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "34639c83c971438f9197057234b1b85b"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "3fca74e2733d85e2f23c82ef8a29a651"
server_key_iv: "4ce69de6ec9d77b1da3543d75ea8836c"
server_key_version: "encryptionkey@0"
I20260810 14:33:13.685338 18077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:13.708755 18077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:13.712507 18077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:13.712736 18077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:13.713441 18077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:13.714716 18141 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:33:13.719039 18077 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:33:13.719118 18077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260810 14:33:13.719194 18077 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:33:13.721100 18077 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:33:13.721169 18077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260810 14:33:13.721436 18141 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Bootstrap starting.
I20260810 14:33:13.732786 18077 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:45421
I20260810 14:33:13.733064 18267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:45421 every 8 connection(s)
I20260810 14:33:13.734149 18077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:33:13.734540 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 18077
I20260810 14:33:13.735013 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:46541
--local_ip_for_outbound_sockets=127.1.206.66
--tserver_master_addrs=127.1.206.126:43381
--webserver_port=45113
--webserver_interface=127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:13.744710 18141 log.cc:824] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:13.754884 18141 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:33:13.755370 18141 tablet_bootstrap.cc:492] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Bootstrap complete.
I20260810 14:33:13.756932 18141 ts_tablet_manager.cc:1397] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Time spent bootstrapping tablet: real 0.036s user 0.023s sys 0.012s
I20260810 14:33:13.760464 18141 raft_consensus.cc:348] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.761054 18141 raft_consensus.cc:729] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34639c83c971438f9197057234b1b85b, State: Initialized, Role: FOLLOWER
I20260810 14:33:13.761664 18141 consensus_queue.cc:260] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:13.762799 18141 ts_tablet_manager.cc:1428] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260810 14:33:13.775645 18271 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:33:13.737127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:53685)
0810 14:33:13.738481 (+ 1354us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.738552 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:13.739741 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:13.774840 (+ 35099us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1077,"thread_start_us":192,"threads_started":1}
W20260810 14:33:13.776332 18268 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:43381 (0 consecutive failures): Network error: Failed to ping master at 127.1.206.126:43381: Client connection negotiation failed: client connection to 127.1.206.126:43381: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:33:13.777137 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.776879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:43179)
0810 14:33:13.777003 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.777079 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 14:33:13.777985 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.777792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:40115)
0810 14:33:13.777894 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.777939 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 14:33:13.778234 18268 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:33:13.864579 18270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:13.864918 18270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:13.865002 18270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:13.869244 18270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:13.869323 18270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:13.869416 18270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:33:13.875157 18270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:46541
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=45113
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:13.876371 18270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:13.877447 18270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:13.887845 18279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:13.887871 18278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:13.887847 18281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:13.888105 18270 server_base.cc:1034] running on GCE node
I20260810 14:33:13.888743 18270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:13.889403 18270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:13.890566 18270 hybrid_clock.cc:648] HybridClock initialized: now 1786372393890516 us; error 63 us; skew 500 ppm
Aug 10 14:33:13 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372393, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:13.893584 18270 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:33:13.894521 18270 webserver.cc:460] Webserver started at http://127.1.206.66:45113/ using document root <none> and password file <none>
I20260810 14:33:13.895073 18270 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:13.895135 18270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:13.899183 18270 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:33:13.901538 18290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:13.902887 18270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:33:13.903041 18270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "83a7f100e3034601922178b324bd9c92"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "0de8bad7fb5132bcdd46488a7c1c12f2"
server_key_iv: "95222866e0056f63dd3074331a0beefe"
server_key_version: "encryptionkey@0"
I20260810 14:33:13.903635 18270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:13.913949 18270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:13.917220 18270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:13.917444 18270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:13.918088 18270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:13.918972 18270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:13.919021 18270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:13.919062 18270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:13.919077 18270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:13.928608 18270 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:46541
I20260810 14:33:13.928643 18416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:46541 every 8 connection(s)
I20260810 14:33:13.929673 18270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:33:13.933547 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.931928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:38713)
0810 14:33:13.932703 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.932815 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":136,"threads_started":1}
W20260810 14:33:13.934047 18417 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:43381 (0 consecutive failures): Network error: Failed to ping master at 127.1.206.126:43381: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
I20260810 14:33:13.934671 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.934436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:49031)
0810 14:33:13.934555 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.934609 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 14:33:13.935400 18419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:13.935207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:44765)
0810 14:33:13.935306 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:13.935349 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 14:33:13.935609 18417 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 14:33:13.936158 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 18270
I20260810 14:33:13.936604 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:38645
--local_ip_for_outbound_sockets=127.1.206.67
--tserver_master_addrs=127.1.206.126:43381
--webserver_port=36287
--webserver_interface=127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:14.055107 18420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:14.055459 18420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:14.055549 18420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:14.059774 18420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:14.059876 18420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:14.059969 18420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:33:14.065773 18420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:38645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=36287
--tserver_master_addrs=127.1.206.126:43381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:14.066936 18420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:14.068074 18420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:14.078219 18428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:14.078235 18425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:14.078241 18426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:14.078572 18420 server_base.cc:1034] running on GCE node
I20260810 14:33:14.079202 18420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:14.080056 18420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:14.081250 18420 hybrid_clock.cc:648] HybridClock initialized: now 1786372394081237 us; error 36 us; skew 500 ppm
Aug 10 14:33:14 dist-test-slave-0b58 krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372394, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:14.084543 18420 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:33:14.085529 18420 webserver.cc:460] Webserver started at http://127.1.206.67:36287/ using document root <none> and password file <none>
I20260810 14:33:14.086130 18420 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:14.086198 18420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:14.090328 18420 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 14:33:14.092563 18437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:14.093849 18420 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:33:14.094002 18420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "4f4ee927ae7e49deb02c1929f1f3e417"
format_stamp: "Formatted at 2026-08-10 14:33:11 on dist-test-slave-0b58"
server_key: "723fcf9077f19b533616b98e307f5f23"
server_key_iv: "e1ac390b13efbaf67cdfba2762067059"
server_key_version: "encryptionkey@0"
I20260810 14:33:14.094571 18420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:14.116421 18420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:14.119652 18420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:14.119887 18420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:14.120575 18420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:14.121465 18420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:14.121515 18420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:14.121556 18420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:14.121610 18420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:14.131459 18420 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:38645
I20260810 14:33:14.131487 18566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:38645 every 8 connection(s)
I20260810 14:33:14.132674 18420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:33:14.134775 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 18420
I20260810 14:33:14.136809 18569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:14.135058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:44291)
0810 14:33:14.135887 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:14.136033 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":126,"threads_started":1}
W20260810 14:33:14.137318 18567 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:43381 (0 consecutive failures): Network error: Failed to ping master at 127.1.206.126:43381: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
I20260810 14:33:14.137914 18569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:14.137694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:50863)
0810 14:33:14.137804 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:14.137850 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 14:33:14.138515 18569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:14.138334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:52857)
0810 14:33:14.138425 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:14.138465 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 14:33:14.138679 18567 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 14:33:14.779227 18571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:14.778816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:56631)
0810 14:33:14.779073 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:14.779127 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":75,"threads_started":1}
I20260810 14:33:14.936725 18572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:14.936245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:56921)
0810 14:33:14.936542 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:14.936607 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":73,"threads_started":1}
I20260810 14:33:15.139808 18573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:15.139354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:40795)
0810 14:33:15.139623 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:15.139688 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":76,"threads_started":1}
I20260810 14:33:15.559423 18574 raft_consensus.cc:482] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:15.559753 18574 raft_consensus.cc:504] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:15.561138 18574 leader_election.cc:288] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645), 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
Aug 10 14:33:15 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372393, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.66@KRBTEST.COM
Aug 10 14:33:15 dist-test-slave-0b58 krb5kdc[16766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372393, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.67@KRBTEST.COM
I20260810 14:33:15.576459 18575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:15.561397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38645 (local address 127.1.206.65:51987)
0810 14:33:15.561774 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:15.561793 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:15.561924 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:15.563802 (+ 1878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:15.563808 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:15.564397 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:15.565020 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:15.565040 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.566390 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.566393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:15.567386 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:15.567397 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.568168 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.568171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:15.568398 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:15.569160 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:15.569173 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:15.571217 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:15.573623 (+ 2406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:15.573626 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:15.573627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:15.573996 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:15.574365 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:15.574367 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:15.574369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:15.574544 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:15.575444 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:15.575449 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:15.575703 (+ 254us) client_negotiation.cc:769] Sending connection context
0810 14:33:15.575869 (+ 166us) client_negotiation.cc:240] Negotiation successful
0810 14:33:15.576210 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":104,"spinlock_wait_cycles":3456,"thread_start_us":97,"threads_started":1}
I20260810 14:33:15.576581 18578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:15.561580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:51987 (local address 127.1.206.67:38645)
0810 14:33:15.562190 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:15.562210 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:15.562243 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:33:15.562889 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:15.562896 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:15.563352 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:15.563779 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:15.565217 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.566231 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.567517 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.568025 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.568205 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:15.571442 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:15.571447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:15.571459 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:15.571491 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:15.573462 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:15.574123 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:15.574130 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:15.574135 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:15.574277 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:15.574685 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:15.574688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:15.574690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:15.575324 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:15.575468 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:15.576037 (+ 569us) server_negotiation.cc:299] Negotiation successful
0810 14:33:15.576393 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":72,"threads_started":1}
I20260810 14:33:15.576826 18579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:15.561678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:44117 (local address 127.1.206.66:46541)
0810 14:33:15.562086 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:15.562100 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:15.562141 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:33:15.562966 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:15.562976 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:15.563347 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:15.563734 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:15.565262 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.566350 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.567520 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.568074 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.568301 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:15.571229 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:15.571235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:15.571248 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:15.571282 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:15.573360 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:15.574476 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:15.574482 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:15.574487 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:15.574647 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:15.575392 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:15.575398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:15.575403 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:15.575827 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:15.575986 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:15.576361 (+ 375us) server_negotiation.cc:299] Negotiation successful
0810 14:33:15.576633 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":155,"threads_started":1}
I20260810 14:33:15.577320 18576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:15.561534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:46541 (local address 127.1.206.65:44117)
0810 14:33:15.561905 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:15.561920 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:15.562038 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:15.563802 (+ 1764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:15.563809 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:15.564425 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:15.565020 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:15.565040 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.566502 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.566508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:15.567381 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:15.567391 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:15.568238 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:15.568242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:15.568398 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:15.569113 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:15.569131 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:15.570952 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:15.573562 (+ 2610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:15.573569 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:15.573584 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:15.573996 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:15.575156 (+ 1160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:15.575162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:15.575164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:15.575264 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:15.575970 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:15.575973 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:15.576069 (+ 96us) client_negotiation.cc:769] Sending connection context
0810 14:33:15.576191 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 14:33:15.576342 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":54,"spinlock_wait_cycles":4864,"thread_start_us":76,"threads_started":1}
W20260810 14:33:15.579097 18135 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
W20260810 14:33:15.579272 18137 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:15.579321 18135 leader_election.cc:302] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34639c83c971438f9197057234b1b85b; no voters: 4f4ee927ae7e49deb02c1929f1f3e417, 83a7f100e3034601922178b324bd9c92
I20260810 14:33:15.579630 18574 raft_consensus.cc:2726] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:33:15.780493 18576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:15.780113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:32897)
0810 14:33:15.780324 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:15.780396 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 14:33:15.938123 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:15.937660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:47987)
0810 14:33:15.937942 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:15.938007 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":82,"threads_started":1}
I20260810 14:33:16.141019 18582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:16.140600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:50617)
0810 14:33:16.140868 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:16.140923 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":74,"threads_started":1}
I20260810 14:33:16.781695 18583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:16.781255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:44823)
0810 14:33:16.781536 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:16.781594 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":88,"threads_started":1}
I20260810 14:33:16.939337 18584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:16.938912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:36937)
0810 14:33:16.939178 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:16.939238 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":78,"threads_started":1}
I20260810 14:33:17.142388 18585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:17.141927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:34805)
0810 14:33:17.142197 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:17.142262 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":82,"threads_started":1}
I20260810 14:33:17.469195 18586 raft_consensus.cc:482] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:17.469316 18586 raft_consensus.cc:504] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:17.469744 18586 leader_election.cc:288] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645), 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
W20260810 14:33:17.470649 18135 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
W20260810 14:33:17.470747 18137 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:17.470870 18137 leader_election.cc:302] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34639c83c971438f9197057234b1b85b; no voters: 4f4ee927ae7e49deb02c1929f1f3e417, 83a7f100e3034601922178b324bd9c92
I20260810 14:33:17.471096 18586 raft_consensus.cc:2726] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:33:17.783095 18587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:17.782627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:58615)
0810 14:33:17.782927 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:17.782993 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":95,"threads_started":1}
I20260810 14:33:17.940704 18588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:17.940198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:52877)
0810 14:33:17.940534 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:17.940599 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":144,"threads_started":1}
I20260810 14:33:18.143723 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:18.143262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:41281)
0810 14:33:18.143557 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:18.143626 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":84,"threads_started":1}
I20260810 14:33:18.784646 18590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:18.784133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:47965)
0810 14:33:18.784488 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:18.784549 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":126,"threads_started":1}
I20260810 14:33:18.942021 18591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:18.941587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:41799)
0810 14:33:18.941866 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:18.941924 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":76,"threads_started":1}
I20260810 14:33:19.145130 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:19.144703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:56749)
0810 14:33:19.144971 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:19.145035 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260810 14:33:19.785984 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:19.785527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:48917)
0810 14:33:19.785818 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:19.785881 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":97,"threads_started":1}
I20260810 14:33:19.943195 18594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:19.942800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:43931)
0810 14:33:19.943044 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:19.943099 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":77,"threads_started":1}
I20260810 14:33:20.146539 18595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:20.146046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:45265)
0810 14:33:20.146360 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:20.146431 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":104,"threads_started":1}
I20260810 14:33:20.516723 18596 raft_consensus.cc:482] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:20.516860 18596 raft_consensus.cc:504] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:20.517359 18596 leader_election.cc:288] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645), 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
W20260810 14:33:20.518188 18135 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
W20260810 14:33:20.518292 18137 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:20.518358 18137 leader_election.cc:302] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34639c83c971438f9197057234b1b85b; no voters: 4f4ee927ae7e49deb02c1929f1f3e417, 83a7f100e3034601922178b324bd9c92
I20260810 14:33:20.518496 18596 raft_consensus.cc:2726] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:33:20.787273 18597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:20.786821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:53695)
0810 14:33:20.787110 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:20.787172 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":82,"threads_started":1}
I20260810 14:33:20.944504 18598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:20.943973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:55085)
0810 14:33:20.944352 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:20.944407 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":135,"threads_started":1}
I20260810 14:33:21.147995 18599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:21.147427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:45447)
0810 14:33:21.147788 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:21.147863 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":78,"threads_started":1}
I20260810 14:33:21.788710 18600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:21.788200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:43613)
0810 14:33:21.788538 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:21.788607 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":111,"threads_started":1}
I20260810 14:33:21.945876 18601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:21.945371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:48577)
0810 14:33:21.945700 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:21.945775 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":84,"threads_started":1}
I20260810 14:33:22.149441 18602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:22.148879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:39717)
0810 14:33:22.149229 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:22.149314 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":93,"threads_started":1}
I20260810 14:33:22.790104 18606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:22.789561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:51095)
0810 14:33:22.789930 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:22.789998 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":81,"threads_started":1}
I20260810 14:33:22.947499 18607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:22.946883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:58025)
0810 14:33:22.947237 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:22.947347 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":121,"threads_started":1}
I20260810 14:33:23.150734 18608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:23.150295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:49353)
0810 14:33:23.150575 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:23.150635 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":83,"threads_started":1}
I20260810 14:33:23.155634 18609 raft_consensus.cc:482] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:23.155771 18609 raft_consensus.cc:504] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:23.156337 18609 leader_election.cc:288] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645), 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
W20260810 14:33:23.157153 18135 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
W20260810 14:33:23.157264 18137 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:23.157379 18137 leader_election.cc:302] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34639c83c971438f9197057234b1b85b; no voters: 4f4ee927ae7e49deb02c1929f1f3e417, 83a7f100e3034601922178b324bd9c92
I20260810 14:33:23.157541 18609 raft_consensus.cc:2726] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:33:23.791460 18610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:23.791009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:34063)
0810 14:33:23.791296 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:23.791359 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":78,"threads_started":1}
I20260810 14:33:23.948869 18611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:23.948412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:35405)
0810 14:33:23.948691 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:23.948753 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":91,"threads_started":1}
I20260810 14:33:24.152240 18612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:24.151782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:46679)
0810 14:33:24.152072 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:24.152138 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":99,"threads_started":1}
I20260810 14:33:24.792858 18615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:24.792384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:44963)
0810 14:33:24.792685 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:24.792753 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":75,"threads_started":1}
I20260810 14:33:24.950345 18616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:24.949824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:56615)
0810 14:33:24.950168 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:24.950243 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":101,"threads_started":1}
I20260810 14:33:25.153599 18617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:25.153145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:34701)
0810 14:33:25.153427 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:25.153491 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":97,"threads_started":1}
I20260810 14:33:25.794327 18618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:25.793821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:52323)
0810 14:33:25.794148 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:25.794216 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":105,"threads_started":1}
I20260810 14:33:25.951926 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:25.951399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:57757)
0810 14:33:25.951749 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:25.951821 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":101,"threads_started":1}
I20260810 14:33:26.155104 18620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:26.154510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:33007)
0810 14:33:26.154949 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:26.155005 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":133,"threads_started":1}
I20260810 14:33:26.795943 18621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:26.795419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:60115)
0810 14:33:26.795774 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:26.795841 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":100,"threads_started":1}
I20260810 14:33:26.953593 18622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:26.953071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:58169)
0810 14:33:26.953413 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:26.953486 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":84,"threads_started":1}
I20260810 14:33:27.156629 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:27.156088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:49871)
0810 14:33:27.156459 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:27.156529 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":90,"threads_started":1}
I20260810 14:33:27.797574 18624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:27.796959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:48587)
0810 14:33:27.797352 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:27.797464 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":86,"threads_started":1}
I20260810 14:33:27.955057 18625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:27.954584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:45139)
0810 14:33:27.954889 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:27.954955 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":93,"threads_started":1}
I20260810 14:33:28.158165 18627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:28.157629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:58785)
0810 14:33:28.157982 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:28.158057 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":91,"threads_started":1}
I20260810 14:33:28.799222 18628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:28.798720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.65:53083)
0810 14:33:28.799044 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:28.799112 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":81,"threads_started":1}
I20260810 14:33:28.933806 18629 raft_consensus.cc:482] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:28.933987 18629 raft_consensus.cc:504] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f4ee927ae7e49deb02c1929f1f3e417" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38645 } } peers { permanent_uuid: "83a7f100e3034601922178b324bd9c92" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 46541 } } peers { permanent_uuid: "34639c83c971438f9197057234b1b85b" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 45421 } }
I20260810 14:33:28.934492 18629 leader_election.cc:288] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645), 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541)
W20260810 14:33:28.935452 18135 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f4ee927ae7e49deb02c1929f1f3e417 (127.1.206.67:38645): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
W20260810 14:33:28.935575 18137 leader_election.cc:341] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 83a7f100e3034601922178b324bd9c92 (127.1.206.66:46541): Not found: Tablet not found: 732b77ea8e8d4e16bc9bb590acf27d8d
I20260810 14:33:28.935648 18137 leader_election.cc:302] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34639c83c971438f9197057234b1b85b; no voters: 4f4ee927ae7e49deb02c1929f1f3e417, 83a7f100e3034601922178b324bd9c92
I20260810 14:33:28.935833 18629 raft_consensus.cc:2726] T 732b77ea8e8d4e16bc9bb590acf27d8d P 34639c83c971438f9197057234b1b85b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:33:28.956732 18630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:28.956177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.66:57171)
0810 14:33:28.956552 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:28.956624 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":164,"threads_started":1}
I20260810 14:33:29.141803 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 18077
I20260810 14:33:29.150615 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 18270
I20260810 14:33:29.159929 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:29.159409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:43381 (local address 127.1.206.67:57929)
0810 14:33:29.159739 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:29.159810 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:43381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":106,"threads_started":1}
I20260810 14:33:29.161844 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 18420
2026-08-10T14:33:29Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19411 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:33:29 dist-test-slave-0b58 krb5kdc[18635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:33:29 dist-test-slave-0b58 krb5kdc[18635](info): set up 2 sockets
Aug 10 14:33:29 dist-test-slave-0b58 krb5kdc[18635](info): commencing operation
krb5kdc: starting...
W20260810 14:33:30.267661 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:33:30 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:33:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:33:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:33:30.405892 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39077
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:30.525933 18652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:30.526264 18652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:30.526309 18652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:30.530550 18652 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 14:33:30.530625 18652 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 14:33:30.530642 18652 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 14:33:30.530655 18652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:30.530675 18652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:30.530694 18652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:30.530750 18652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:30.530781 18652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:30.536509 18652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:30.537732 18652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:30.538830 18652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:30.547549 18661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:30.547549 18660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:30.547552 18663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:30.547897 18652 server_base.cc:1034] running on GCE node
I20260810 14:33:30.548609 18652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:30.549750 18652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:30.550925 18652 hybrid_clock.cc:648] HybridClock initialized: now 1786372410550911 us; error 27 us; skew 500 ppm
Aug 10 14:33:30 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372410, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:30.553885 18652 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:30.554755 18652 webserver.cc:460] Webserver started at http://127.1.206.126:42249/ using document root <none> and password file <none>
I20260810 14:33:30.555281 18652 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:30.555348 18652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:30.555519 18652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:30.557628 18652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "314581e968fc4d5aac738083f89e5197"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "12be1b99cf02be1a7f3f83f50b64f867"
server_key_iv: "00aef05a959cc7c5f003c4e4d9600012"
server_key_version: "encryptionkey@0"
I20260810 14:33:30.558171 18652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "314581e968fc4d5aac738083f89e5197"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "12be1b99cf02be1a7f3f83f50b64f867"
server_key_iv: "00aef05a959cc7c5f003c4e4d9600012"
server_key_version: "encryptionkey@0"
I20260810 14:33:30.561944 18652 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260810 14:33:30.564484 18670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:30.565775 18652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:33:30.565938 18652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "314581e968fc4d5aac738083f89e5197"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "12be1b99cf02be1a7f3f83f50b64f867"
server_key_iv: "00aef05a959cc7c5f003c4e4d9600012"
server_key_version: "encryptionkey@0"
I20260810 14:33:30.566068 18652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:30.584518 18652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:30.587844 18652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:30.588075 18652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:30.595584 18652 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39077
I20260810 14:33:30.595927 18730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39077 every 8 connection(s)
I20260810 14:33:30.596652 18652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:30.599526 18731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:30.604110 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 18652
I20260810 14:33:30.604249 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:33:30.604615 1849 external_mini_cluster.cc:1428] Setting key 389431b3e52894305515a9df214ed24d
I20260810 14:33:30.605950 18731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Bootstrap starting.
I20260810 14:33:30.608533 18731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:30.609375 18731 log.cc:824] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:30.611388 18731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: No bootstrap required, opened a new log
Aug 10 14:33:30 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:30.615448 18731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:30.615767 18731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:30.615866 18731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314581e968fc4d5aac738083f89e5197, State: Initialized, Role: FOLLOWER
I20260810 14:33:30.616405 18731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:30.616571 18731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:33:30.616652 18731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:33:30.616779 18731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:30.618012 18731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:30.618412 18731 leader_election.cc:302] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 314581e968fc4d5aac738083f89e5197; no voters:
I20260810 14:33:30.618836 18731 leader_election.cc:288] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:33:30.618953 18736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:30.619242 18736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 LEADER]: Becoming Leader. State: Replica: 314581e968fc4d5aac738083f89e5197, State: Running, Role: LEADER
I20260810 14:33:30.619621 18736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:30.620116 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:30.606137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.1.206.126:39077)
0810 14:33:30.606565 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:30.606582 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:30.606617 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:33:30.607267 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:30.607283 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:30.607612 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:30.607889 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:30.608875 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:30.609961 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:30.610878 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:30.611380 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:30.611569 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:30.614204 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:30.614209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:30.614226 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:30.614258 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:30.616662 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:30.617272 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:30.617278 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:30.617283 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:30.617415 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:30.617749 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:30.617752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:30.617754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:30.618255 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:30.618431 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:30.618749 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 14:33:30.619125 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":135,"threads_started":1}
I20260810 14:33:30.620200 18731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:30.620901 18736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314581e968fc4d5aac738083f89e5197. Latest consensus state: current_term: 1 leader_uuid: "314581e968fc4d5aac738083f89e5197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } } }
I20260810 14:33:30.621683 18736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:30.621570 18738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "314581e968fc4d5aac738083f89e5197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } } }
I20260810 14:33:30.622014 18738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:30.622773 18747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:30.625694 18747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:30.632146 18747 catalog_manager.cc:1347] Generated new cluster ID: fd2fc13fc7f04e61b703b87e9f5245a0
I20260810 14:33:30.632239 18747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:33:30.643622 18747 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:33:30.644901 18747 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:33:30.649206 18747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Generated new TSK 0
I20260810 14:33:30.649942 18747 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:33:30.686859 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39077
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:30.805658 18761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:30.805974 18761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:30.806020 18761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:30.810261 18761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:30.810346 18761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:30.810411 18761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:33:30.815968 18761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:30.817256 18761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:30.818356 18761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:30.828811 18771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:30.828805 18767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:30.828805 18769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:30.829421 18761 server_base.cc:1034] running on GCE node
I20260810 14:33:30.829887 18761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:30.830617 18761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:30.831861 18761 hybrid_clock.cc:648] HybridClock initialized: now 1786372410831833 us; error 34 us; skew 500 ppm
Aug 10 14:33:30 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372410, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:30.835078 18761 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:33:30.836153 18761 webserver.cc:460] Webserver started at http://127.1.206.65:37635/ using document root <none> and password file <none>
I20260810 14:33:30.836819 18761 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:30.836918 18761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:30.837178 18761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:30.839342 18761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "b91264e5226d4e8991dc672fec0963d2"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "3c30bc9e9805d3bbf5da6766a5345a4d"
server_key_iv: "533b26b6e5e9d7ab2f97df6cbc92d0e3"
server_key_version: "encryptionkey@0"
I20260810 14:33:30.839995 18761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "b91264e5226d4e8991dc672fec0963d2"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "3c30bc9e9805d3bbf5da6766a5345a4d"
server_key_iv: "533b26b6e5e9d7ab2f97df6cbc92d0e3"
server_key_version: "encryptionkey@0"
I20260810 14:33:30.843883 18761 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260810 14:33:30.846618 18781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:30.847980 18761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:33:30.848165 18761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "b91264e5226d4e8991dc672fec0963d2"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "3c30bc9e9805d3bbf5da6766a5345a4d"
server_key_iv: "533b26b6e5e9d7ab2f97df6cbc92d0e3"
server_key_version: "encryptionkey@0"
I20260810 14:33:30.848338 18761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:30.884379 18761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:30.888031 18761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:30.888325 18761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:30.888967 18761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:30.889899 18761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:30.889954 18761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:30.889998 18761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:30.890015 18761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:30.900480 18761 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:34123
I20260810 14:33:30.900568 18908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:34123 every 8 connection(s)
I20260810 14:33:30.901540 18761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:33:30.905515 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 18761
I20260810 14:33:30.905627 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:33:30.905941 1849 external_mini_cluster.cc:1428] Setting key 161a96b4b22ff991dff04d4c8f1e7067
Aug 10 14:33:30 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372410, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:33:30.917725 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:30.903632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:38411 (local address 127.1.206.126:39077)
0810 14:33:30.903795 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:30.903799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:30.904967 (+ 1168us) server_negotiation.cc:407] Connection header received
0810 14:33:30.905989 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:30.905992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:30.906061 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:30.906194 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:30.907949 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:30.908652 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:30.909968 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:30.910248 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:30.910378 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:30.913570 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:30.913574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:30.913576 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:30.913604 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:30.915226 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:30.915863 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:30.915866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:30.915868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:30.915957 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:30.916365 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:30.916370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:30.916372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:30.916576 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:30.916688 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:30.917303 (+ 615us) server_negotiation.cc:299] Negotiation successful
0810 14:33:30.917454 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 14:33:30.918808 18911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:30.904021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:38411)
0810 14:33:30.904790 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:30.904837 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:30.905759 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:30.906456 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:30.906468 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:30.907003 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:30.907785 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:30.907805 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:30.908811 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:30.908814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:30.909819 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:30.909830 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:30.910430 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:30.910434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:30.910643 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:30.911398 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:30.911415 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:30.913352 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:30.915406 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:30.915413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:30.915441 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:30.915737 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:30.916059 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:30.916062 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:30.916064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:30.916223 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:30.916689 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:30.916697 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:30.917038 (+ 341us) client_negotiation.cc:769] Sending connection context
0810 14:33:30.917238 (+ 200us) client_negotiation.cc:240] Negotiation successful
0810 14:33:30.917769 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:33:30.920310 18909 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39077
I20260810 14:33:30.920653 18909 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:30.921314 18909 heartbeater.cc:511] Master 127.1.206.126:39077 requested a full tablet report, sending...
I20260810 14:33:30.923048 18691 ts_manager.cc:194] Registered new tserver with Master: b91264e5226d4e8991dc672fec0963d2 (127.1.206.65:34123)
I20260810 14:33:30.924331 18691 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:38411
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:33:30.937458 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39077
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:31.054327 18914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:31.054636 18914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:31.054680 18914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:31.058911 18914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:31.059000 18914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:31.059063 18914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:33:31.064906 18914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:31.066128 18914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:31.067210 18914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:31.077739 18922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:31.077720 18924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:31.077716 18920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:31.078054 18914 server_base.cc:1034] running on GCE node
I20260810 14:33:31.078562 18914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:31.079298 18914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:31.080504 18914 hybrid_clock.cc:648] HybridClock initialized: now 1786372411080477 us; error 41 us; skew 500 ppm
Aug 10 14:33:31 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372411, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:31.083701 18914 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:33:31.084812 18914 webserver.cc:460] Webserver started at http://127.1.206.66:35277/ using document root <none> and password file <none>
I20260810 14:33:31.085392 18914 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:31.085465 18914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:31.085649 18914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:31.087852 18914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "8710a71cf0424287a51dd5602f098389"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "ec6b775f0f466d4122590b168648b417"
server_key_iv: "16bcc42fac4fdbf4a19fdc9f39a6be83"
server_key_version: "encryptionkey@0"
I20260810 14:33:31.088490 18914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "8710a71cf0424287a51dd5602f098389"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "ec6b775f0f466d4122590b168648b417"
server_key_iv: "16bcc42fac4fdbf4a19fdc9f39a6be83"
server_key_version: "encryptionkey@0"
I20260810 14:33:31.092963 18914 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:33:31.095692 18932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:31.097266 18914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:31.097442 18914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "8710a71cf0424287a51dd5602f098389"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "ec6b775f0f466d4122590b168648b417"
server_key_iv: "16bcc42fac4fdbf4a19fdc9f39a6be83"
server_key_version: "encryptionkey@0"
I20260810 14:33:31.097589 18914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:31.113554 18914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:31.117270 18914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:31.117512 18914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:31.118201 18914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:31.119107 18914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:31.119161 18914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:31.119279 18914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:31.119323 18914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:31.129966 18914 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:41617
I20260810 14:33:31.129983 19065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:41617 every 8 connection(s)
I20260810 14:33:31.130939 18914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:33:31.135473 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 18914
I20260810 14:33:31.135577 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:33:31.135854 1849 external_mini_cluster.cc:1428] Setting key c6415d75256c476b0873213cac629e3d
Aug 10 14:33:31 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372411, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:31.145680 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.132850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:56013 (local address 127.1.206.126:39077)
0810 14:33:31.133006 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.133011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.134134 (+ 1123us) server_negotiation.cc:407] Connection header received
0810 14:33:31.135010 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.135013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.135061 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.135138 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:31.136571 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.137119 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.138299 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.138536 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.138652 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.141633 (+ 2981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:31.141637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:31.141639 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:31.141667 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:31.143257 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:31.143839 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:31.143842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:31.143843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:31.143923 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:31.144320 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:31.144325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:31.144327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:31.144588 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:31.144690 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.145430 (+ 740us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.145549 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:33:31.146946 19068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.133280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:56013)
0810 14:33:31.133977 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.134022 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:31.134824 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:31.135317 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:31.135323 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:31.135774 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:31.136393 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.136428 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.137259 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.137262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.138165 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.138174 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.138698 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.138702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.138886 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.139577 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:31.139607 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:31.141426 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:31.143398 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:31.143405 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:31.143422 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:31.143711 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:31.144023 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:31.144026 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:31.144028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:31.144185 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:31.144724 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:31.144736 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:31.145119 (+ 383us) client_negotiation.cc:769] Sending connection context
0810 14:33:31.145377 (+ 258us) client_negotiation.cc:240] Negotiation successful
0810 14:33:31.145801 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":112,"threads_started":1}
I20260810 14:33:31.148448 19066 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39077
I20260810 14:33:31.148774 19066 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:33:31.149504 19066 heartbeater.cc:511] Master 127.1.206.126:39077 requested a full tablet report, sending...
I20260810 14:33:31.150858 18691 ts_manager.cc:194] Registered new tserver with Master: 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617)
I20260810 14:33:31.151476 18691 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:56013
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:33:31.167649 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39077
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:31.284600 19071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:31.284878 19071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:31.284924 19071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:31.289048 19071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:31.289130 19071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:31.289194 19071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:33:31.294806 19071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:31.295894 19071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:31.296975 19071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:31.306957 19076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:31.307047 19081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:31.307009 19077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:31.307438 19071 server_base.cc:1034] running on GCE node
I20260810 14:33:31.307898 19071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:31.308669 19071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:31.309947 19071 hybrid_clock.cc:648] HybridClock initialized: now 1786372411309902 us; error 31 us; skew 500 ppm
Aug 10 14:33:31 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372411, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:31.313069 19071 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:33:31.314038 19071 webserver.cc:460] Webserver started at http://127.1.206.67:37459/ using document root <none> and password file <none>
I20260810 14:33:31.314643 19071 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:31.314740 19071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:31.315003 19071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:33:31.317324 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "12108ad9bfb94308aadfca9d6540fefc"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "6faf49f740678ce6b457b38e01da9d7e"
server_key_iv: "6e8e635fc6f8002f4cc1915eabcba72d"
server_key_version: "encryptionkey@0"
I20260810 14:33:31.317960 19071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "12108ad9bfb94308aadfca9d6540fefc"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "6faf49f740678ce6b457b38e01da9d7e"
server_key_iv: "6e8e635fc6f8002f4cc1915eabcba72d"
server_key_version: "encryptionkey@0"
I20260810 14:33:31.322180 19071 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:33:31.324708 19089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:31.325984 19071 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:33:31.326134 19071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "12108ad9bfb94308aadfca9d6540fefc"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "6faf49f740678ce6b457b38e01da9d7e"
server_key_iv: "6e8e635fc6f8002f4cc1915eabcba72d"
server_key_version: "encryptionkey@0"
I20260810 14:33:31.326256 19071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:31.343518 19071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:31.346704 19071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:31.346920 19071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:31.347509 19071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:31.348412 19071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:31.348479 19071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:31.348551 19071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:31.348592 19071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:31.357863 19071 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:41017
I20260810 14:33:31.357884 19223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:41017 every 8 connection(s)
I20260810 14:33:31.358794 19071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:33:31.365808 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 19071
I20260810 14:33:31.365969 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:33:31.366282 1849 external_mini_cluster.cc:1428] Setting key 458563dd6a4da6cc9e7d99a42bf0b754
Aug 10 14:33:31 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372411, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:31.372963 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.360683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:38475 (local address 127.1.206.126:39077)
0810 14:33:31.360817 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.360821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.361911 (+ 1090us) server_negotiation.cc:407] Connection header received
0810 14:33:31.362834 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.362838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.362897 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.363003 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:31.364202 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.364813 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.365971 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.366261 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.366375 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.369350 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:31.369353 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:31.369356 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:31.369381 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:31.370950 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:31.371429 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:31.371431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:31.371432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:31.371515 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:31.371816 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:31.371818 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:31.371819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:31.371995 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:31.372071 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.372620 (+ 549us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.372758 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:33:31.374069 19227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.361078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:38475)
0810 14:33:31.361752 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.361794 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:31.362618 (+ 824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:31.363194 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:31.363201 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:31.363581 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:31.364056 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.364069 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.364945 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.364948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.365833 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.365843 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.366420 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.366424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.366598 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.367308 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:31.367331 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:31.369186 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:31.371054 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:31.371059 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:31.371072 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:31.371341 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:31.371594 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:31.371596 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:31.371597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:31.371735 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:31.372082 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:31.372087 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:31.372408 (+ 321us) client_negotiation.cc:769] Sending connection context
0810 14:33:31.372572 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 14:33:31.372933 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":120,"threads_started":1}
I20260810 14:33:31.375200 19225 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39077
I20260810 14:33:31.375459 19225 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:31.375980 19225 heartbeater.cc:511] Master 127.1.206.126:39077 requested a full tablet report, sending...
I20260810 14:33:31.377090 18691 ts_manager.cc:194] Registered new tserver with Master: 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
I20260810 14:33:31.377640 18691 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:38475
I20260810 14:33:31.380366 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:33:31.390048 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.382441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58400 (local address 127.1.206.126:39077)
0810 14:33:31.382650 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.382657 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.382793 (+ 136us) server_negotiation.cc:407] Connection header received
0810 14:33:31.382890 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.382892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.382930 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.382994 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:31.383665 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.384177 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.385101 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.385344 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.385440 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.386887 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:31.386890 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:31.386892 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:31.386915 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:31.388401 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:31.388796 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:31.388799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:31.388800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:31.388879 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:31.389118 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:31.389124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:31.389126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:31.389365 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:31.389470 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.389737 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.389847 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260810 14:33:31.393184 18691 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:33:31.396425 18691 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:33:31.412155 19238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.405604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.1.206.65:34123)
0810 14:33:31.406654 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.406671 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.406694 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:33:31.406774 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.406904 (+ 130us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.407163 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.407350 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:31.407718 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.408740 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.410498 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.411291 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.411403 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.411559 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.411836 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.411949 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":104,"threads_started":1}
I20260810 14:33:31.412139 19239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.405440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34123 (local address 127.0.0.1:55230)
0810 14:33:31.406147 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.406205 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:31.406359 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:31.407338 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:31.407344 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:31.407367 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:31.407544 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.407552 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.408870 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.408877 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.410340 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.410351 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.411440 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.411447 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.411613 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.411653 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 14:33:31.411777 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 14:33:31.411945 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":62,"thread_start_us":146,"threads_started":1}
I20260810 14:33:31.412343 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.405725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:41017 (local address 127.0.0.1:36530)
0810 14:33:31.406733 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.406747 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:31.406831 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:31.408191 (+ 1360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:31.408194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:31.408213 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:31.408351 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.408357 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.409695 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.409701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.410830 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.410841 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.411894 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.411897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.411976 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.411997 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 14:33:31.412074 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 14:33:31.412145 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":939,"thread_start_us":96,"threads_started":1}
I20260810 14:33:31.412539 19240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.406347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36530 (local address 127.1.206.67:41017)
0810 14:33:31.407718 (+ 1371us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.407735 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.407763 (+ 28us) server_negotiation.cc:407] Connection header received
0810 14:33:31.407841 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.407845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.408023 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.408186 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:31.408480 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.409494 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.410976 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.411767 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.411882 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.412017 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.412099 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.412205 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":177,"threads_started":1}
I20260810 14:33:31.412909 19237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.405440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:41617 (local address 127.0.0.1:56710)
0810 14:33:31.406391 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.406406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:31.406509 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:31.407613 (+ 1104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:31.407618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:31.407643 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:31.407736 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.407742 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.409315 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.409319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.410474 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.410484 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.411468 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.411471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.412541 (+ 1070us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.412560 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 14:33:31.412666 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 14:33:31.412748 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":942,"thread_start_us":116,"threads_started":1}
I20260810 14:33:31.413559 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.406415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56710 (local address 127.1.206.66:41617)
0810 14:33:31.407052 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.407064 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.407140 (+ 76us) server_negotiation.cc:407] Connection header received
0810 14:33:31.407220 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.407225 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.407418 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.407704 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:31.407898 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.409161 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.410598 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.411315 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.411596 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.411749 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.413303 (+ 1554us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.413410 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":134,"threads_started":1}
I20260810 14:33:31.415542 18831 tablet_service.cc:1467] Processing CreateTablet for tablet 2a7b8b32afcc47618026aefd22eeda93 (DEFAULT_TABLE table=test-table [id=252c6daa51344fb98591c98cceb30bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:31.415612 19145 tablet_service.cc:1467] Processing CreateTablet for tablet 2a7b8b32afcc47618026aefd22eeda93 (DEFAULT_TABLE table=test-table [id=252c6daa51344fb98591c98cceb30bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:31.416673 18831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a7b8b32afcc47618026aefd22eeda93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:31.416741 19145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a7b8b32afcc47618026aefd22eeda93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:31.416392 18990 tablet_service.cc:1467] Processing CreateTablet for tablet 2a7b8b32afcc47618026aefd22eeda93 (DEFAULT_TABLE table=test-table [id=252c6daa51344fb98591c98cceb30bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:31.417495 18990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a7b8b32afcc47618026aefd22eeda93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:31.424413 19243 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Bootstrap starting.
I20260810 14:33:31.425796 19245 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Bootstrap starting.
I20260810 14:33:31.426005 19247 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Bootstrap starting.
I20260810 14:33:31.427148 19243 tablet_bootstrap.cc:654] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:31.427953 19243 log.cc:824] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:31.428658 19247 tablet_bootstrap.cc:654] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:31.428663 19245 tablet_bootstrap.cc:654] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:31.429661 19247 log.cc:824] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:31.429711 19245 log.cc:824] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:31.430495 19243 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: No bootstrap required, opened a new log
I20260810 14:33:31.430783 19243 ts_tablet_manager.cc:1397] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 14:33:31.431830 19245 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: No bootstrap required, opened a new log
I20260810 14:33:31.431938 19247 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: No bootstrap required, opened a new log
I20260810 14:33:31.432066 19245 ts_tablet_manager.cc:1397] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260810 14:33:31.432147 19247 ts_tablet_manager.cc:1397] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.006s
I20260810 14:33:31.435014 19245 raft_consensus.cc:348] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.435338 19245 raft_consensus.cc:374] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:31.435418 19245 raft_consensus.cc:729] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12108ad9bfb94308aadfca9d6540fefc, State: Initialized, Role: FOLLOWER
I20260810 14:33:31.435635 19243 raft_consensus.cc:348] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.435905 19243 raft_consensus.cc:374] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:31.436025 19243 raft_consensus.cc:729] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91264e5226d4e8991dc672fec0963d2, State: Initialized, Role: FOLLOWER
I20260810 14:33:31.435982 19245 consensus_queue.cc:260] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.436496 19243 consensus_queue.cc:260] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.436728 19225 heartbeater.cc:503] Master 127.1.206.126:39077 was elected leader, sending a full tablet report...
I20260810 14:33:31.437592 19243 ts_tablet_manager.cc:1428] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260810 14:33:31.437484 19247 raft_consensus.cc:348] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.437824 19247 raft_consensus.cc:374] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:31.438030 18909 heartbeater.cc:503] Master 127.1.206.126:39077 was elected leader, sending a full tablet report...
I20260810 14:33:31.438109 19245 ts_tablet_manager.cc:1428] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:33:31.438853 19247 raft_consensus.cc:729] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8710a71cf0424287a51dd5602f098389, State: Initialized, Role: FOLLOWER
I20260810 14:33:31.439328 19247 consensus_queue.cc:260] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.439985 19066 heartbeater.cc:503] Master 127.1.206.126:39077 was elected leader, sending a full tablet report...
I20260810 14:33:31.440364 19247 ts_tablet_manager.cc:1428] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260810 14:33:31.609819 19226 tablet.cc:2369] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:33:31.632139 19067 tablet.cc:2369] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:33:31.653101 18910 tablet.cc:2369] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:31.653564 19252 raft_consensus.cc:482] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:31.653867 19252 raft_consensus.cc:504] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.655077 19252 leader_election.cc:288] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b91264e5226d4e8991dc672fec0963d2 (127.1.206.65:34123), 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617)
I20260810 14:33:31.659083 19238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.655460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:51945 (local address 127.1.206.65:34123)
0810 14:33:31.655623 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.655628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.655646 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:33:31.655739 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.655741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.655789 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.655894 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:31.656190 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.656773 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.658033 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.658475 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.658615 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.658673 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.658875 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.658954 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 14:33:31.659085 19227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.655306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34123 (local address 127.1.206.67:51945)
0810 14:33:31.655444 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.655464 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:31.655572 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:31.655908 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:31.655912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:31.655941 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:31.656067 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.656072 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.656927 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.656931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.657870 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.657881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.658615 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.658619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.658743 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.658762 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 14:33:31.658855 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 14:33:31.658937 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":101,"spinlock_wait_cycles":3456}
I20260810 14:33:31.659258 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.655631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:57619 (local address 127.1.206.66:41617)
0810 14:33:31.655777 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.655782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.655902 (+ 120us) server_negotiation.cc:407] Connection header received
0810 14:33:31.656051 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.656054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.656105 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.656194 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:31.656485 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.656978 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.658250 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.658651 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.658791 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.658845 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.659045 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.659126 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:33:31.659273 19255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.655442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:41617 (local address 127.1.206.67:57619)
0810 14:33:31.655790 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.655806 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:31.655931 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:31.656205 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:31.656208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:31.656225 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:31.656373 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.656378 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.657097 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.657101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.657921 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:31.657929 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.658791 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.658794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:31.658908 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.658927 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 14:33:31.659018 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 14:33:31.659089 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":1,"thread_start_us":120,"threads_started":1}
I20260810 14:33:31.659941 19014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7b8b32afcc47618026aefd22eeda93" candidate_uuid: "12108ad9bfb94308aadfca9d6540fefc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8710a71cf0424287a51dd5602f098389" is_pre_election: true
I20260810 14:33:31.659952 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7b8b32afcc47618026aefd22eeda93" candidate_uuid: "12108ad9bfb94308aadfca9d6540fefc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b91264e5226d4e8991dc672fec0963d2" is_pre_election: true
I20260810 14:33:31.660332 19014 raft_consensus.cc:2454] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12108ad9bfb94308aadfca9d6540fefc in term 0.
I20260810 14:33:31.660338 18858 raft_consensus.cc:2454] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12108ad9bfb94308aadfca9d6540fefc in term 0.
I20260810 14:33:31.660847 19091 leader_election.cc:302] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12108ad9bfb94308aadfca9d6540fefc, 8710a71cf0424287a51dd5602f098389; no voters:
I20260810 14:33:31.661173 19252 raft_consensus.cc:2781] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:33:31.661273 19252 raft_consensus.cc:482] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:33:31.661329 19252 raft_consensus.cc:3037] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:31.662451 19252 raft_consensus.cc:504] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.662901 19252 leader_election.cc:288] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [CANDIDATE]: Term 1 election: Requested vote from peers b91264e5226d4e8991dc672fec0963d2 (127.1.206.65:34123), 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617)
I20260810 14:33:31.663295 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7b8b32afcc47618026aefd22eeda93" candidate_uuid: "12108ad9bfb94308aadfca9d6540fefc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b91264e5226d4e8991dc672fec0963d2"
I20260810 14:33:31.663440 19014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7b8b32afcc47618026aefd22eeda93" candidate_uuid: "12108ad9bfb94308aadfca9d6540fefc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8710a71cf0424287a51dd5602f098389"
I20260810 14:33:31.663483 18858 raft_consensus.cc:3037] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:31.663580 19014 raft_consensus.cc:3037] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:31.664963 18858 raft_consensus.cc:2454] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12108ad9bfb94308aadfca9d6540fefc in term 1.
I20260810 14:33:31.664963 19014 raft_consensus.cc:2454] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12108ad9bfb94308aadfca9d6540fefc in term 1.
I20260810 14:33:31.665354 19091 leader_election.cc:302] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12108ad9bfb94308aadfca9d6540fefc, 8710a71cf0424287a51dd5602f098389; no voters:
I20260810 14:33:31.665555 19252 raft_consensus.cc:2781] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:31.665841 19252 raft_consensus.cc:686] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 1 LEADER]: Becoming Leader. State: Replica: 12108ad9bfb94308aadfca9d6540fefc, State: Running, Role: LEADER
I20260810 14:33:31.666235 19252 consensus_queue.cc:237] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:31.669684 18688 catalog_manager.cc:5495] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc reported cstate change: term changed from 0 to 1, leader changed from <none> to 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67). New cstate: current_term: 1 leader_uuid: "12108ad9bfb94308aadfca9d6540fefc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } health_report { overall_health: HEALTHY } } }
I20260810 14:33:31.708495 19240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.704851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36534 (local address 127.1.206.67:41017)
0810 14:33:31.704991 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:31.704995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:31.705008 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:33:31.705087 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:31.705089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:31.705151 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:31.705242 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:33:31.705526 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.706107 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.707009 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:31.707253 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:31.707345 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:31.707645 (+ 300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:33:31.708096 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:33:31.708193 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:31.708320 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 14:33:31.708381 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:33:31.714671 18858 raft_consensus.cc:1261] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Refusing update from remote peer 12108ad9bfb94308aadfca9d6540fefc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:31.714704 19014 raft_consensus.cc:1261] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Refusing update from remote peer 12108ad9bfb94308aadfca9d6540fefc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:31.715512 19256 consensus_queue.cc:1035] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:31.715718 19252 consensus_queue.cc:1035] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:31.723770 19260 mvcc.cc:205] Tried to move back new op lower bound from 7316981398375075840 to 7316981398187675648. Current Snapshot: MvccSnapshot[applied={T|T < 7316981398375075840}]
I20260810 14:33:31.725140 19262 mvcc.cc:205] Tried to move back new op lower bound from 7316981398375075840 to 7316981398187675648. Current Snapshot: MvccSnapshot[applied={T|T < 7316981398375075840}]
I20260810 14:33:31.733387 18690 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:31.733639 18690 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:31.736225 18690 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Sending DeleteTablet for 3 replicas of tablet 2a7b8b32afcc47618026aefd22eeda93
I20260810 14:33:31.737174 19145 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a7b8b32afcc47618026aefd22eeda93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:36530
I20260810 14:33:31.737174 18831 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a7b8b32afcc47618026aefd22eeda93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:55230
I20260810 14:33:31.737743 19275 tablet_replica.cc:330] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: stopping tablet replica
I20260810 14:33:31.737726 18990 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a7b8b32afcc47618026aefd22eeda93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:56710
I20260810 14:33:31.738106 19275 raft_consensus.cc:2229] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:33:31.738253 19276 tablet_replica.cc:330] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: stopping tablet replica
I20260810 14:33:31.738507 19275 raft_consensus.cc:2258] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:31.738610 19276 raft_consensus.cc:2229] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:31.738679 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 18761
I20260810 14:33:31.738896 19273 tablet_replica.cc:330] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: stopping tablet replica
I20260810 14:33:31.738971 19276 raft_consensus.cc:2258] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:31.741852 19275 ts_tablet_manager.cc:1905] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:31.744323 19276 ts_tablet_manager.cc:1905] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:31.745905 19275 ts_tablet_manager.cc:1918] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:31.746059 19275 log.cc:1196] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/2a7b8b32afcc47618026aefd22eeda93
I20260810 14:33:31.746479 19275 ts_tablet_manager.cc:1939] T 2a7b8b32afcc47618026aefd22eeda93 P 12108ad9bfb94308aadfca9d6540fefc: Deleting consensus metadata
I20260810 14:33:31.747114 19276 ts_tablet_manager.cc:1918] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:31.747248 19276 log.cc:1196] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/2a7b8b32afcc47618026aefd22eeda93
I20260810 14:33:31.747596 19276 ts_tablet_manager.cc:1939] T 2a7b8b32afcc47618026aefd22eeda93 P 8710a71cf0424287a51dd5602f098389: Deleting consensus metadata
I20260810 14:33:31.748004 18674 catalog_manager.cc:4841] TS 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017): tablet 2a7b8b32afcc47618026aefd22eeda93 (table test-table [id=252c6daa51344fb98591c98cceb30bfd]) successfully deleted
I20260810 14:33:31.748945 18672 catalog_manager.cc:4841] TS 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617): tablet 2a7b8b32afcc47618026aefd22eeda93 (table test-table [id=252c6daa51344fb98591c98cceb30bfd]) successfully deleted
W20260810 14:33:31.751286 18675 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:34123 (error 108)
I20260810 14:33:31.752211 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 18914
I20260810 14:33:31.752517 19239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:31.752165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34123 (local address 127.0.0.1:55234)
0810 14:33:31.752329 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:31.752413 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:34123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 14:33:31.753886 18675 catalog_manager.cc:4584] TS b91264e5226d4e8991dc672fec0963d2 (127.1.206.65:34123): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2a7b8b32afcc47618026aefd22eeda93: Network error: Client connection negotiation failed: client connection to 127.1.206.65:34123: connect: Connection refused (error 111)
I20260810 14:33:31.763986 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 19071
I20260810 14:33:31.772455 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 18652
I20260810 14:33:51.782680 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39077
--webserver_interface=127.1.206.126
--webserver_port=42249
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:33:51.904455 19278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:51.904752 19278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:51.904830 19278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:51.909247 19278 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 14:33:51.909336 19278 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 14:33:51.909368 19278 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 14:33:51.909400 19278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:33:51.909442 19278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:51.909484 19278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:51.909519 19278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:33:51.909554 19278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:33:51.915095 19278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:51.916303 19278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:51.917394 19278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:51.932374 19285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:51.932407 19287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:51.932448 19278 server_base.cc:1034] running on GCE node
W20260810 14:33:51.932384 19284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:51.933243 19278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:51.934687 19278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:51.935915 19278 hybrid_clock.cc:648] HybridClock initialized: now 1786372431935900 us; error 28 us; skew 500 ppm
Aug 10 14:33:51 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372431, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:51.938946 19278 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:33:51.939839 19278 webserver.cc:460] Webserver started at http://127.1.206.126:42249/ using document root <none> and password file <none>
I20260810 14:33:51.940526 19278 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:51.940603 19278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:51.944808 19278 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 14:33:51.947201 19297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:51.948563 19278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:51.948714 19278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "314581e968fc4d5aac738083f89e5197"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "12be1b99cf02be1a7f3f83f50b64f867"
server_key_iv: "00aef05a959cc7c5f003c4e4d9600012"
server_key_version: "encryptionkey@0"
I20260810 14:33:51.949343 19278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:51.969384 19278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:51.973047 19278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:51.973461 19278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:51.981178 19278 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39077
I20260810 14:33:51.981544 19357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39077 every 8 connection(s)
I20260810 14:33:51.982422 19278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:33:51.986979 19358 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:33:51.988718 19358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Bootstrap starting.
I20260810 14:33:51.991045 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 19278
I20260810 14:33:51.991492 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:34123
--local_ip_for_outbound_sockets=127.1.206.65
--tserver_master_addrs=127.1.206.126:39077
--webserver_port=37635
--webserver_interface=127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:52.007139 19358 log.cc:824] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:52.016642 19358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:33:52.017127 19358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Bootstrap complete.
I20260810 14:33:52.021869 19358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:52.022348 19358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314581e968fc4d5aac738083f89e5197, State: Initialized, Role: FOLLOWER
I20260810 14:33:52.022905 19358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:52.023061 19358 raft_consensus.cc:388] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:33:52.023169 19358 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:33:52.023293 19358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:33:52.025497 19358 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:52.025861 19358 leader_election.cc:302] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 314581e968fc4d5aac738083f89e5197; no voters:
I20260810 14:33:52.026386 19358 leader_election.cc:288] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:33:52.026495 19362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:33:52.026746 19362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 LEADER]: Becoming Leader. State: Replica: 314581e968fc4d5aac738083f89e5197, State: Running, Role: LEADER
I20260810 14:33:52.027117 19362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:33:52.028014 19358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:33:52.028893 19364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314581e968fc4d5aac738083f89e5197. Latest consensus state: current_term: 2 leader_uuid: "314581e968fc4d5aac738083f89e5197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } } }
I20260810 14:33:52.029042 19364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:52.029590 19363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "314581e968fc4d5aac738083f89e5197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } } }
I20260810 14:33:52.029762 19363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: This master's current role is: LEADER
I20260810 14:33:52.030097 19371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:33:52.034204 19371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:33:52.035003 19371 catalog_manager.cc:1259] Loaded cluster ID: fd2fc13fc7f04e61b703b87e9f5245a0
I20260810 14:33:52.035089 19371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:33:52.037139 19371 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:33:52.037747 19371 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Loaded TSK: 0
I20260810 14:33:52.059828 19371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Generated new TSK 1
I20260810 14:33:52.060148 19371 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:33:52.123494 19360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:52.123766 19360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:52.123811 19360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:52.127908 19360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:52.128000 19360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:52.128109 19360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:33:52.133827 19360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:34123
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=37635
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:52.134850 19360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:52.135834 19360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:52.145612 19388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:52.145663 19387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:52.145622 19391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:52.146188 19360 server_base.cc:1034] running on GCE node
I20260810 14:33:52.146584 19360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:52.147177 19360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:52.148363 19360 hybrid_clock.cc:648] HybridClock initialized: now 1786372432148336 us; error 42 us; skew 500 ppm
Aug 10 14:33:52 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372432, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:52.151245 19360 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:33:52.152217 19360 webserver.cc:460] Webserver started at http://127.1.206.65:37635/ using document root <none> and password file <none>
I20260810 14:33:52.152918 19360 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:52.153004 19360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:52.157368 19360 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 14:33:52.159927 19398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:52.161435 19360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:33:52.161619 19360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "b91264e5226d4e8991dc672fec0963d2"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "3c30bc9e9805d3bbf5da6766a5345a4d"
server_key_iv: "533b26b6e5e9d7ab2f97df6cbc92d0e3"
server_key_version: "encryptionkey@0"
I20260810 14:33:52.162218 19360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:52.174975 19360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:52.178388 19360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:52.178603 19360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:52.179315 19360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:52.180508 19407 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:33:52.184806 19360 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:33:52.184885 19360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260810 14:33:52.184964 19360 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:33:52.187032 19360 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:33:52.187093 19360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 14:33:52.187356 19407 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Bootstrap starting.
I20260810 14:33:52.198107 19360 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:34123
I20260810 14:33:52.198194 19532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:34123 every 8 connection(s)
I20260810 14:33:52.199380 19360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:33:52.199636 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 19360
I20260810 14:33:52.200166 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:41617
--local_ip_for_outbound_sockets=127.1.206.66
--tserver_master_addrs=127.1.206.126:39077
--webserver_port=35277
--webserver_interface=127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:33:52.210597 19407 log.cc:824] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:33:52 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372432, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:52.217864 19407 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:33:52.218387 19407 tablet_bootstrap.cc:492] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Bootstrap complete.
I20260810 14:33:52.219604 19407 ts_tablet_manager.cc:1397] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.016s
I20260810 14:33:52.222386 19407 raft_consensus.cc:348] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:52.223062 19407 raft_consensus.cc:729] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91264e5226d4e8991dc672fec0963d2, State: Initialized, Role: FOLLOWER
I20260810 14:33:52.223107 19537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.202139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:45527 (local address 127.1.206.126:39077)
0810 14:33:52.202535 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.202560 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.204114 (+ 1554us) server_negotiation.cc:407] Connection header received
0810 14:33:52.205345 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.205356 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.205639 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.205976 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:52.207236 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.208200 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.209415 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.209883 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.210065 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.217036 (+ 6971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:52.217044 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:52.217059 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:52.217096 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:52.219365 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.220021 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.220027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.220035 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.220212 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.220637 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.220640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.220642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.221096 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:52.221225 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.221840 (+ 615us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.222130 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":144,"threads_started":1}
I20260810 14:33:52.223635 19407 consensus_queue.cc:260] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } } peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } }
I20260810 14:33:52.224819 19407 ts_tablet_manager.cc:1428] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260810 14:33:52.226598 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.202139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:45527)
0810 14:33:52.203936 (+ 1797us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.203978 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.204909 (+ 931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.206038 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.206047 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.206582 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:52.207050 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.207064 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.208414 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.208417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.209284 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.209293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.210032 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.210036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.210236 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.210919 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:52.210935 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:52.216808 (+ 5873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:52.219503 (+ 2695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.219510 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.219523 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.219885 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.220365 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.220368 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.220370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.220534 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.221222 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:52.221236 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:52.221514 (+ 278us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.221709 (+ 195us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.222030 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1608,"thread_start_us":162,"threads_started":1}
I20260810 14:33:52.230690 19533 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39077
I20260810 14:33:52.230957 19533 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:52.231597 19533 heartbeater.cc:511] Master 127.1.206.126:39077 requested a full tablet report, sending...
I20260810 14:33:52.234340 19317 ts_manager.cc:194] Registered new tserver with Master: b91264e5226d4e8991dc672fec0963d2 (127.1.206.65:34123)
I20260810 14:33:52.237864 19317 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:45527
I20260810 14:33:52.240649 19533 heartbeater.cc:503] Master 127.1.206.126:39077 was elected leader, sending a full tablet report...
Aug 10 14:33:52 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372431, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.65@KRBTEST.COM
I20260810 14:33:52.248555 19542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.237199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34123 (local address 127.0.0.1:46696)
0810 14:33:52.237975 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.238018 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.238162 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.238871 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.238877 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.239234 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:52.239337 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.239344 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.240527 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.240531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.241343 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.241357 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.242114 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.242119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.242230 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.242854 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:52.242867 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:52.244531 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:52.246743 (+ 2212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.246752 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.246756 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.247006 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.247357 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.247359 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.247361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.247442 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.247971 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:52.247976 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:52.248078 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.248200 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.248424 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":113,"threads_started":1}
I20260810 14:33:52.248667 19543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.237290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46696 (local address 127.1.206.65:34123)
0810 14:33:52.237719 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.237731 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.238308 (+ 577us) server_negotiation.cc:407] Connection header received
0810 14:33:52.238386 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.238391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.238582 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.238872 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:52.239464 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.240413 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.241472 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.241974 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.242086 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.244672 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:52.244682 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:52.244695 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:52.244721 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:52.246592 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.247148 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.247155 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.247157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.247255 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.247539 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.247544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.247546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.247855 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:52.247983 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.248321 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.248498 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":149,"threads_started":1}
I20260810 14:33:52.249938 19459 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a7b8b32afcc47618026aefd22eeda93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:46696
I20260810 14:33:52.250834 19544 tablet_replica.cc:330] stopping tablet replica
I20260810 14:33:52.251139 19544 raft_consensus.cc:2229] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:52.251395 19544 raft_consensus.cc:2258] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:52.252496 19544 ts_tablet_manager.cc:1905] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:52.256484 19544 ts_tablet_manager.cc:1918] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:52.256613 19544 log.cc:1196] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal/wals/2a7b8b32afcc47618026aefd22eeda93
I20260810 14:33:52.256897 19544 ts_tablet_manager.cc:1939] T 2a7b8b32afcc47618026aefd22eeda93 P b91264e5226d4e8991dc672fec0963d2: Deleting consensus metadata
I20260810 14:33:52.258674 19302 catalog_manager.cc:4841] TS b91264e5226d4e8991dc672fec0963d2 (127.1.206.65:34123): tablet 2a7b8b32afcc47618026aefd22eeda93 (table test-table [id=252c6daa51344fb98591c98cceb30bfd]) successfully deleted
W20260810 14:33:52.326359 19536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:52.326668 19536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:52.326745 19536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:52.331103 19536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:52.331193 19536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:52.331287 19536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:33:52.336584 19536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:41617
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=35277
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:52.337658 19536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:52.338678 19536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:33:52.348409 19536 server_base.cc:1034] running on GCE node
W20260810 14:33:52.348418 19552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:52.348428 19549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:52.348601 19550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:52.349053 19536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:52.349650 19536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:52.350852 19536 hybrid_clock.cc:648] HybridClock initialized: now 1786372432350842 us; error 31 us; skew 500 ppm
Aug 10 14:33:52 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372432, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:52.353657 19536 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:33:52.354590 19536 webserver.cc:460] Webserver started at http://127.1.206.66:35277/ using document root <none> and password file <none>
I20260810 14:33:52.355086 19536 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:52.355159 19536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:52.358878 19536 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:33:52.360978 19561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:52.362207 19536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:33:52.362317 19536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "8710a71cf0424287a51dd5602f098389"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "ec6b775f0f466d4122590b168648b417"
server_key_iv: "16bcc42fac4fdbf4a19fdc9f39a6be83"
server_key_version: "encryptionkey@0"
I20260810 14:33:52.362835 19536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:52.388636 19536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:52.391631 19536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:52.391794 19536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:52.392429 19536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:52.393270 19536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:52.393325 19536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:52.393368 19536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:52.393388 19536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:52.402654 19536 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:41617
I20260810 14:33:52.402673 19693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:41617 every 8 connection(s)
I20260810 14:33:52.403661 19536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:33:52.410035 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 19536
I20260810 14:33:52.410509 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:41017
--local_ip_for_outbound_sockets=127.1.206.67
--tserver_master_addrs=127.1.206.126:39077
--webserver_port=37459
--webserver_interface=127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:33:52 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372432, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:52.417953 19537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.405535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:41131 (local address 127.1.206.126:39077)
0810 14:33:52.405721 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.405726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.406766 (+ 1040us) server_negotiation.cc:407] Connection header received
0810 14:33:52.407632 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.407635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.407684 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.407760 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:52.408974 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.409511 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.410864 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.411277 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.411411 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.414221 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:52.414224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:52.414226 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:52.414254 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:52.415793 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.416365 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.416369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.416370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.416458 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.416817 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.416820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.416821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.417010 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:52.417121 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.417628 (+ 507us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.417774 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 14:33:52.418742 19696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.405914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:41131)
0810 14:33:52.406602 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.406645 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.407441 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.407953 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.407960 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.408348 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:52.408836 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.408850 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.409619 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.409621 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.410715 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.410729 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.411458 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.411461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.411603 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.412291 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:52.412318 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:52.414037 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:52.415916 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.415922 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.415938 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.416211 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.416556 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.416559 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.416561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.416712 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.417119 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:52.417126 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:52.417383 (+ 257us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.417570 (+ 187us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.417918 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":137,"threads_started":1}
I20260810 14:33:52.420150 19694 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39077
I20260810 14:33:52.420449 19694 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:52.420953 19694 heartbeater.cc:511] Master 127.1.206.126:39077 requested a full tablet report, sending...
I20260810 14:33:52.422107 19317 ts_manager.cc:194] Registered new tserver with Master: 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617)
I20260810 14:33:52.423002 19317 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:41131
W20260810 14:33:52.530310 19698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:33:52.530717 19698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:33:52.530772 19698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:33:52.535133 19698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:33:52.535210 19698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:33:52.535274 19698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:33:52.540841 19698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:41017
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=37459
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:33:52.541980 19698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:33:52.542985 19698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:33:52.552681 19706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:33:52.552754 19704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:52.552934 19698 server_base.cc:1034] running on GCE node
W20260810 14:33:52.552896 19703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:33:52.553387 19698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:33:52.554208 19698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:33:52.555390 19698 hybrid_clock.cc:648] HybridClock initialized: now 1786372432555373 us; error 30 us; skew 500 ppm
Aug 10 14:33:52 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372432, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:33:52.558518 19698 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:33:52.559432 19698 webserver.cc:460] Webserver started at http://127.1.206.67:37459/ using document root <none> and password file <none>
I20260810 14:33:52.559986 19698 fs_manager.cc:359] Metadata directory not provided
I20260810 14:33:52.560065 19698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:33:52.564575 19698 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:33:52.567188 19715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:52.568626 19698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:33:52.568776 19698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "12108ad9bfb94308aadfca9d6540fefc"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "6faf49f740678ce6b457b38e01da9d7e"
server_key_iv: "6e8e635fc6f8002f4cc1915eabcba72d"
server_key_version: "encryptionkey@0"
I20260810 14:33:52.569353 19698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:33:52.585999 19698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:33:52.589385 19698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:33:52.589614 19698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:33:52.590273 19698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:33:52.591153 19698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:33:52.591202 19698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:52.591274 19698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:33:52.591305 19698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:33:52.600718 19698 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:41017
I20260810 14:33:52.600756 19846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:41017 every 8 connection(s)
I20260810 14:33:52.601780 19698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:33:52.609246 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 19698
Aug 10 14:33:52 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372432, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:33:52.616631 19537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.603755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:44565 (local address 127.1.206.126:39077)
0810 14:33:52.603916 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.603920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.604883 (+ 963us) server_negotiation.cc:407] Connection header received
0810 14:33:52.605792 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.605795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.605846 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.605924 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:52.607150 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.607690 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.609002 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.609376 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.609488 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.612569 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:52.612573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:52.612577 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:52.612616 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:52.614208 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.614901 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.614904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.614905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.614983 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.615405 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.615407 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.615409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.615629 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:52.615733 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.616247 (+ 514us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.616466 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 14:33:52.617383 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.604037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:44565)
0810 14:33:52.604744 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.604786 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.605588 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.606099 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.606105 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.606500 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:33:52.606987 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.607000 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.607830 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.607833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.608869 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.608880 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.609553 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.609556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.609760 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.610547 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:33:52.610572 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:33:52.612412 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:33:52.614359 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.614367 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.614386 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.614775 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.615079 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:33:52.615084 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:33:52.615088 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:33:52.615292 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:33:52.615737 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:33:52.615742 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:33:52.615986 (+ 244us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.616183 (+ 197us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.616553 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":148,"threads_started":1}
I20260810 14:33:52.618664 19847 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39077
I20260810 14:33:52.618912 19847 heartbeater.cc:464] Registering TS with master...
I20260810 14:33:52.619201 19850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.610069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44770 (local address 127.1.206.126:39077)
0810 14:33:52.610389 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.610395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.610592 (+ 197us) server_negotiation.cc:407] Connection header received
0810 14:33:52.610724 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.610726 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.610767 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.610852 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:52.611817 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.612471 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.613587 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.613981 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.614106 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.615582 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:52.615586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:52.615589 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:52.615609 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:52.617476 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.617996 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.617999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.618000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.618078 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.618377 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.618381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.618383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.618560 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:52.618789 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.618916 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.619039 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":105,"threads_started":1}
I20260810 14:33:52.619513 19847 heartbeater.cc:511] Master 127.1.206.126:39077 requested a full tablet report, sending...
I20260810 14:33:52.620684 19316 ts_manager.cc:194] Registered new tserver with Master: 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
I20260810 14:33:52.621364 19316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:44565
I20260810 14:33:52.633147 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:33:52.637180 19850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.633803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.1.206.126:39077)
0810 14:33:52.633944 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.633949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.634133 (+ 184us) server_negotiation.cc:407] Connection header received
0810 14:33:52.634278 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.634280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.634391 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.634479 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:33:52.634711 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.635222 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.636073 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.636377 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.636460 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.636731 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:33:52.636869 (+ 138us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 14:33:52.637080 (+ 211us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44782: token expired
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 14:33:52.637291 19850 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44782: token expired
W20260810 14:33:52.637722 19231 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.206.126:39077)
I20260810 14:33:52.644569 19850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.638094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44792 (local address 127.1.206.126:39077)
0810 14:33:52.638214 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.638217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.638228 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:33:52.638314 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.638316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.638351 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.638411 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:33:52.639004 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.639475 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.640205 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.640436 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.640509 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.641831 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:33:52.641834 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:33:52.641836 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:33:52.641854 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:33:52.643121 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.643502 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.643505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.643506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.643580 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:33:52.643815 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:33:52.643818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:33:52.643819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:33:52.643979 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:33:52.644077 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.644286 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.644387 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 14:33:52.646956 19316 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:33:52.650211 19316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:33:52.659933 19459 tablet_service.cc:1467] Processing CreateTablet for tablet eca80976eec34c1ea3d22eebb404d3db (DEFAULT_TABLE table=test-table [id=9c723ed95a6a407c9e8d8a871bdec7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:52.660642 19459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eca80976eec34c1ea3d22eebb404d3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:52.663117 19542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.657684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:41617 (local address 127.0.0.1:53088)
0810 14:33:52.657926 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.657941 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.658033 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.658956 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.658962 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.658985 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:52.659114 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.659125 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.660744 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.660747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.661617 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.661627 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.662586 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.662590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.662714 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.662777 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.662864 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.662971 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260810 14:33:52.663189 19858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.657942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53088 (local address 127.1.206.66:41617)
0810 14:33:52.658345 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.658362 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.658395 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:33:52.658494 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.658501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.658770 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.658962 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:52.659286 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.660610 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.661767 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.662446 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.662581 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.662757 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.662914 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.663028 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":131,"threads_started":1}
I20260810 14:33:52.663460 19407 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Bootstrap starting.
I20260810 14:33:52.664465 19407 tablet_bootstrap.cc:654] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:52.666582 19619 tablet_service.cc:1467] Processing CreateTablet for tablet eca80976eec34c1ea3d22eebb404d3db (DEFAULT_TABLE table=test-table [id=9c723ed95a6a407c9e8d8a871bdec7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:52.667498 19407 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: No bootstrap required, opened a new log
I20260810 14:33:52.667622 19407 ts_tablet_manager.cc:1397] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260810 14:33:52.667965 19619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eca80976eec34c1ea3d22eebb404d3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:52.668227 19407 raft_consensus.cc:348] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.668835 19407 raft_consensus.cc:374] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:52.668955 19407 raft_consensus.cc:729] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91264e5226d4e8991dc672fec0963d2, State: Initialized, Role: FOLLOWER
I20260810 14:33:52.669236 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.659031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:41017 (local address 127.0.0.1:59582)
0810 14:33:52.659290 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.659304 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.659385 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.664556 (+ 5171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.664559 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.664584 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:52.664703 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.664710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.666178 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.666182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.667624 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.667636 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.668798 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.668802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.668895 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.668922 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.669003 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.669081 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":119,"threads_started":1}
I20260810 14:33:52.669309 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.659669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59582 (local address 127.1.206.67:41017)
0810 14:33:52.663980 (+ 4311us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.663989 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.664011 (+ 22us) server_negotiation.cc:407] Connection header received
0810 14:33:52.664112 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.664117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.664378 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.664558 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:52.664842 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.665995 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.667790 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.668669 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.668781 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.668942 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.669037 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.669141 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4212,"thread_start_us":177,"threads_started":1}
I20260810 14:33:52.669217 19407 consensus_queue.cc:260] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.672254 19771 tablet_service.cc:1467] Processing CreateTablet for tablet eca80976eec34c1ea3d22eebb404d3db (DEFAULT_TABLE table=test-table [id=9c723ed95a6a407c9e8d8a871bdec7b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:33:52.673552 19771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eca80976eec34c1ea3d22eebb404d3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:33:52.675933 19863 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Bootstrap starting.
I20260810 14:33:52.670236 19407 ts_tablet_manager.cc:1428] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:33:52.678725 19863 tablet_bootstrap.cc:654] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:52.679476 19863 log.cc:824] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:52.681254 19865 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Bootstrap starting.
I20260810 14:33:52.681689 19863 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: No bootstrap required, opened a new log
I20260810 14:33:52.681979 19863 ts_tablet_manager.cc:1397] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:33:52.683619 19865 tablet_bootstrap.cc:654] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Neither blocks nor log segments found. Creating new log.
I20260810 14:33:52.684971 19865 log.cc:824] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:33:52.686172 19863 raft_consensus.cc:348] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.686473 19863 raft_consensus.cc:374] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:52.686535 19863 raft_consensus.cc:729] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8710a71cf0424287a51dd5602f098389, State: Initialized, Role: FOLLOWER
I20260810 14:33:52.687006 19863 consensus_queue.cc:260] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.687197 19865 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: No bootstrap required, opened a new log
I20260810 14:33:52.687403 19865 ts_tablet_manager.cc:1397] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 14:33:52.687786 19694 heartbeater.cc:503] Master 127.1.206.126:39077 was elected leader, sending a full tablet report...
I20260810 14:33:52.688189 19863 ts_tablet_manager.cc:1428] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:33:52.690954 19865 raft_consensus.cc:348] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.691222 19865 raft_consensus.cc:374] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:33:52.691303 19865 raft_consensus.cc:729] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12108ad9bfb94308aadfca9d6540fefc, State: Initialized, Role: FOLLOWER
I20260810 14:33:52.691781 19865 consensus_queue.cc:260] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.692433 19847 heartbeater.cc:503] Master 127.1.206.126:39077 was elected leader, sending a full tablet report...
I20260810 14:33:52.692788 19865 ts_tablet_manager.cc:1428] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
W20260810 14:33:52.700603 19535 tablet.cc:2369] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:33:52.770987 19541 raft_consensus.cc:482] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:33:52.771339 19541 raft_consensus.cc:504] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.772691 19541 leader_election.cc:288] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617), 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
I20260810 14:33:52.778481 19860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.773115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:51863 (local address 127.1.206.67:41017)
0810 14:33:52.773254 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.773259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.773512 (+ 253us) server_negotiation.cc:407] Connection header received
0810 14:33:52.773723 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.773726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.773777 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.773872 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:52.774137 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.774979 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.776837 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.777535 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.777667 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.777721 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.778253 (+ 532us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.778344 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:33:52.778481 19858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.773123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:46189 (local address 127.1.206.66:41617)
0810 14:33:52.773254 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.773259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.773688 (+ 429us) server_negotiation.cc:407] Connection header received
0810 14:33:52.773862 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.773865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.773919 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.774030 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:33:52.774250 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.774977 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.776837 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.777519 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.777667 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.777721 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.778259 (+ 538us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.778343 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 14:33:52.778504 19870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.772992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:41617 (local address 127.1.206.65:46189)
0810 14:33:52.773565 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.773578 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.773733 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.774032 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.774035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.774050 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:52.774143 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.774152 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.775113 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.775117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.776675 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.776688 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.777691 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.777696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.777941 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.778045 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.778140 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.778297 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":244,"thread_start_us":89,"threads_started":1}
I20260810 14:33:52.778520 19869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.772992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:41017 (local address 127.1.206.65:51863)
0810 14:33:52.773394 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.773408 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:33:52.773575 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:33:52.773887 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:33:52.773890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:33:52.773908 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:33:52.774024 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.774031 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.775140 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.775143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.776686 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:33:52.776692 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.777691 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.777696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:33:52.777945 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.778044 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 14:33:52.778142 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 14:33:52.778297 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":281,"thread_start_us":93,"threads_started":1}
I20260810 14:33:52.779292 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca80976eec34c1ea3d22eebb404d3db" candidate_uuid: "b91264e5226d4e8991dc672fec0963d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8710a71cf0424287a51dd5602f098389" is_pre_election: true
I20260810 14:33:52.779461 19793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca80976eec34c1ea3d22eebb404d3db" candidate_uuid: "b91264e5226d4e8991dc672fec0963d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12108ad9bfb94308aadfca9d6540fefc" is_pre_election: true
I20260810 14:33:52.779670 19643 raft_consensus.cc:2454] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b91264e5226d4e8991dc672fec0963d2 in term 0.
I20260810 14:33:52.779816 19793 raft_consensus.cc:2454] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b91264e5226d4e8991dc672fec0963d2 in term 0.
I20260810 14:33:52.780254 19401 leader_election.cc:302] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8710a71cf0424287a51dd5602f098389, b91264e5226d4e8991dc672fec0963d2; no voters:
I20260810 14:33:52.780612 19541 raft_consensus.cc:2781] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:33:52.780727 19541 raft_consensus.cc:482] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:33:52.780792 19541 raft_consensus.cc:3037] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:52.782389 19541 raft_consensus.cc:504] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.782783 19541 leader_election.cc:288] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 1 election: Requested vote from peers 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617), 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
I20260810 14:33:52.783210 19793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca80976eec34c1ea3d22eebb404d3db" candidate_uuid: "b91264e5226d4e8991dc672fec0963d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12108ad9bfb94308aadfca9d6540fefc"
I20260810 14:33:52.783277 19643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eca80976eec34c1ea3d22eebb404d3db" candidate_uuid: "b91264e5226d4e8991dc672fec0963d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8710a71cf0424287a51dd5602f098389"
I20260810 14:33:52.783360 19793 raft_consensus.cc:3037] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:52.783399 19643 raft_consensus.cc:3037] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:33:52.784775 19793 raft_consensus.cc:2454] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b91264e5226d4e8991dc672fec0963d2 in term 1.
I20260810 14:33:52.784775 19643 raft_consensus.cc:2454] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b91264e5226d4e8991dc672fec0963d2 in term 1.
I20260810 14:33:52.785148 19401 leader_election.cc:302] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8710a71cf0424287a51dd5602f098389, b91264e5226d4e8991dc672fec0963d2; no voters:
I20260810 14:33:52.785444 19541 raft_consensus.cc:2781] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:33:52.785614 19541 raft_consensus.cc:686] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 LEADER]: Becoming Leader. State: Replica: b91264e5226d4e8991dc672fec0963d2, State: Running, Role: LEADER
I20260810 14:33:52.785879 19541 consensus_queue.cc:237] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:33:52.788975 19316 catalog_manager.cc:5495] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b91264e5226d4e8991dc672fec0963d2 (127.1.206.65). New cstate: current_term: 1 leader_uuid: "b91264e5226d4e8991dc672fec0963d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } health_report { overall_health: HEALTHY } } }
I20260810 14:33:52.821358 19874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.817347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46702 (local address 127.1.206.65:34123)
0810 14:33:52.817716 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0810 14:33:52.817724 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:33:52.817738 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:33:52.817816 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:33:52.817818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:33:52.817873 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:33:52.817986 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:33:52.818260 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.818785 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.819683 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:33:52.819914 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:33:52.819999 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:33:52.820365 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:33:52.820840 (+ 475us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:33:52.820934 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 14:33:52.821050 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 14:33:52.821122 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":141,"threads_started":1}
I20260810 14:33:52.825497 19793 raft_consensus.cc:1261] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 1 FOLLOWER]: Refusing update from remote peer b91264e5226d4e8991dc672fec0963d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:52.825498 19643 raft_consensus.cc:1261] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Refusing update from remote peer b91264e5226d4e8991dc672fec0963d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:33:52.826294 19541 consensus_queue.cc:1035] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:52.826507 19871 consensus_queue.cc:1035] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:33:52.837129 19875 mvcc.cc:205] Tried to move back new op lower bound from 7316981484846551040 to 7316981484693585920. Current Snapshot: MvccSnapshot[applied={T|T < 7316981484846551040 or (T in {7316981484846551040})}]
I20260810 14:33:52.844460 19316 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:52.844630 19316 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:33:52.847175 19316 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Sending DeleteTablet for 3 replicas of tablet eca80976eec34c1ea3d22eebb404d3db
I20260810 14:33:52.848022 19771 tablet_service.cc:1514] Processing DeleteTablet for tablet eca80976eec34c1ea3d22eebb404d3db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:52 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:59582
I20260810 14:33:52.848183 19619 tablet_service.cc:1514] Processing DeleteTablet for tablet eca80976eec34c1ea3d22eebb404d3db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:33:52 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:53088
I20260810 14:33:52.848235 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 19360
I20260810 14:33:52.851189 19887 tablet_replica.cc:330] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: stopping tablet replica
I20260810 14:33:52.851562 19887 raft_consensus.cc:2229] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:52.851742 19889 tablet_replica.cc:330] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: stopping tablet replica
I20260810 14:33:52.851917 19887 raft_consensus.cc:2258] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:52.852052 19889 raft_consensus.cc:2229] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:33:52.852388 19889 raft_consensus.cc:2258] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:33:52.853929 19889 ts_tablet_manager.cc:1905] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:52.853984 19887 ts_tablet_manager.cc:1905] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:33:52.856851 19889 ts_tablet_manager.cc:1918] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:52.856856 19887 ts_tablet_manager.cc:1918] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:33:52.856977 19889 log.cc:1196] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/eca80976eec34c1ea3d22eebb404d3db
I20260810 14:33:52.856977 19887 log.cc:1196] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/eca80976eec34c1ea3d22eebb404d3db
I20260810 14:33:52.857386 19889 ts_tablet_manager.cc:1939] T eca80976eec34c1ea3d22eebb404d3db P 8710a71cf0424287a51dd5602f098389: Deleting consensus metadata
I20260810 14:33:52.857386 19887 ts_tablet_manager.cc:1939] T eca80976eec34c1ea3d22eebb404d3db P 12108ad9bfb94308aadfca9d6540fefc: Deleting consensus metadata
W20260810 14:33:52.858450 19302 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:34123 (error 108)
I20260810 14:33:52.858767 19299 catalog_manager.cc:4841] TS 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617): tablet eca80976eec34c1ea3d22eebb404d3db (table test-table [id=9c723ed95a6a407c9e8d8a871bdec7b1]) successfully deleted
I20260810 14:33:52.858872 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 19536
I20260810 14:33:52.860924 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:33:52.860466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:34123 (local address 127.0.0.1:46704)
0810 14:33:52.860781 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 14:33:52.860846 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:34123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
W20260810 14:33:52.861155 19302 catalog_manager.cc:4584] TS b91264e5226d4e8991dc672fec0963d2 (127.1.206.65:34123): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eca80976eec34c1ea3d22eebb404d3db: Network error: Client connection negotiation failed: client connection to 127.1.206.65:34123: connect: Connection refused (error 111)
I20260810 14:33:52.862228 19301 catalog_manager.cc:4841] TS 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017): tablet eca80976eec34c1ea3d22eebb404d3db (table test-table [id=9c723ed95a6a407c9e8d8a871bdec7b1]) successfully deleted
I20260810 14:33:52.867939 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 19698
I20260810 14:33:52.874892 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 19278
I20260810 14:34:12.883764 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39077
--webserver_interface=127.1.206.126
--webserver_port=42249
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:13.002140 19892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:13.002457 19892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:13.002502 19892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:13.006784 19892 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 14:34:13.006871 19892 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 14:34:13.006889 19892 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 14:34:13.006909 19892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:13.006934 19892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:13.006953 19892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:13.006969 19892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:13.006985 19892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:13.012789 19892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39077
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=42249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:13.013911 19892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:13.014947 19892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:13.023874 19898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:13.023887 19899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:13.023936 19892 server_base.cc:1034] running on GCE node
W20260810 14:34:13.023887 19901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:13.024788 19892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:13.025959 19892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:13.027163 19892 hybrid_clock.cc:648] HybridClock initialized: now 1786372453027127 us; error 50 us; skew 500 ppm
Aug 10 14:34:13 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372453, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:13.030117 19892 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:34:13.031092 19892 webserver.cc:460] Webserver started at http://127.1.206.126:42249/ using document root <none> and password file <none>
I20260810 14:34:13.031646 19892 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:13.031706 19892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:13.035630 19892 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:34:13.037925 19909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.039243 19892 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:34:13.039408 19892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "314581e968fc4d5aac738083f89e5197"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "12be1b99cf02be1a7f3f83f50b64f867"
server_key_iv: "00aef05a959cc7c5f003c4e4d9600012"
server_key_version: "encryptionkey@0"
I20260810 14:34:13.040040 19892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:13.057271 19892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:13.060952 19892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:13.061174 19892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:13.069322 19892 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39077
I20260810 14:34:13.069790 19965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39077 every 8 connection(s)
I20260810 14:34:13.070583 19892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:13.072355 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 19892
I20260810 14:34:13.072906 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:34123
--local_ip_for_outbound_sockets=127.1.206.65
--tserver_master_addrs=127.1.206.126:39077
--webserver_port=37635
--webserver_interface=127.1.206.65
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:34:13.076583 19966 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:34:13.078673 19966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Bootstrap starting.
I20260810 14:34:13.099153 19966 log.cc:824] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:13.111536 19966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:34:13.112036 19966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Bootstrap complete.
I20260810 14:34:13.116868 19966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:34:13.117339 19966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314581e968fc4d5aac738083f89e5197, State: Initialized, Role: FOLLOWER
I20260810 14:34:13.117902 19966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:34:13.118042 19966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:13.118146 19966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:13.118287 19966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 2 FOLLOWER]: Advancing to term 3
I20260810 14:34:13.120682 19966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:34:13.121080 19966 leader_election.cc:302] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 314581e968fc4d5aac738083f89e5197; no voters:
I20260810 14:34:13.121491 19966 leader_election.cc:288] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 14:34:13.121591 19970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 14:34:13.121811 19970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [term 3 LEADER]: Becoming Leader. State: Replica: 314581e968fc4d5aac738083f89e5197, State: Running, Role: LEADER
I20260810 14:34:13.122221 19970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } }
I20260810 14:34:13.122947 19966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:13.123837 19971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "314581e968fc4d5aac738083f89e5197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } } }
I20260810 14:34:13.123992 19971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:13.124617 19972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314581e968fc4d5aac738083f89e5197. Latest consensus state: current_term: 3 leader_uuid: "314581e968fc4d5aac738083f89e5197" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314581e968fc4d5aac738083f89e5197" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39077 } } }
I20260810 14:34:13.124760 19972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:13.125077 19979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:13.130734 19979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:13.131592 19979 catalog_manager.cc:1259] Loaded cluster ID: fd2fc13fc7f04e61b703b87e9f5245a0
I20260810 14:34:13.131671 19979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:13.134832 19979 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:13.135720 19979 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Loaded TSK: 0
I20260810 14:34:13.135823 19979 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 314581e968fc4d5aac738083f89e5197: Loaded TSK: 1
F20260810 14:34:13.137302 19979 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc7f62039ad google::LogMessage::Fail() at ??:0
@ 0x7fc7f620688a google::LogMessage::SendToLog() at ??:0
@ 0x7fc7f62034de google::LogMessage::Flush() at ??:0
@ 0x7fc7f6204a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc7f8ec718d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc7f8ebff0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fc800b687bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fc800b4299c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fc800b43178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fc800b84df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fc800ba382b std::function<>::operator()() at ??:0
@ 0x7fc800b42b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fc800b43f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc800b40579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fc800b84640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fc7f84553d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc7f8455c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fc7f84573f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fc7f8446512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc7f9a8a6db start_thread at ??:0
@ 0x7fc7f4d0161f clone at ??:0
W20260810 14:34:13.216238 19968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:13.216553 19968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:13.216598 19968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:13.221212 19968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:13.221266 19968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:13.221328 19968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:34:13.228942 19968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:34123
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=37635
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:13.230600 19968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:13.231787 19968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:13.244587 20020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:13.244583 20017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:13.244928 19968 server_base.cc:1034] running on GCE node
W20260810 14:34:13.245086 20016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:13.246073 19968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:13.246841 19968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:13.248028 19968 hybrid_clock.cc:648] HybridClock initialized: now 1786372453247984 us; error 55 us; skew 500 ppm
Aug 10 14:34:13 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372453, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:13.251935 19968 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:34:13.253355 19968 webserver.cc:460] Webserver started at http://127.1.206.65:37635/ using document root <none> and password file <none>
I20260810 14:34:13.254134 19968 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:13.254225 19968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:13.259764 19968 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 14:34:13.263109 20031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.265105 19968 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260810 14:34:13.265265 19968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "b91264e5226d4e8991dc672fec0963d2"
format_stamp: "Formatted at 2026-08-10 14:33:30 on dist-test-slave-0b58"
server_key: "3c30bc9e9805d3bbf5da6766a5345a4d"
server_key_iv: "533b26b6e5e9d7ab2f97df6cbc92d0e3"
server_key_version: "encryptionkey@0"
I20260810 14:34:13.266072 19968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:13.283303 19968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:13.287518 19968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:13.287751 19968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:13.288553 19968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:13.289978 20039 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:34:13.294543 19968 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:34:13.294637 19968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260810 14:34:13.294718 19968 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:34:13.297044 19968 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:34:13.297111 19968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:13.297472 20039 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Bootstrap starting.
I20260810 14:34:13.308561 19968 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:34123
I20260810 14:34:13.308940 20159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:34123 every 8 connection(s)
I20260810 14:34:13.309813 19968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:34:13.311893 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 19968
I20260810 14:34:13.312486 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:41617
--local_ip_for_outbound_sockets=127.1.206.66
--tserver_master_addrs=127.1.206.126:39077
--webserver_port=35277
--webserver_interface=127.1.206.66
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:34:13.321148 20039 log.cc:824] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:13.331784 20039 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:34:13.332283 20039 tablet_bootstrap.cc:492] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Bootstrap complete.
I20260810 14:34:13.333928 20039 ts_tablet_manager.cc:1397] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Time spent bootstrapping tablet: real 0.037s user 0.030s sys 0.004s
I20260810 14:34:13.337700 20039 raft_consensus.cc:348] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:34:13.338285 20039 raft_consensus.cc:729] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b91264e5226d4e8991dc672fec0963d2, State: Initialized, Role: FOLLOWER
I20260810 14:34:13.338857 20039 consensus_queue.cc:260] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:34:13.339988 20039 ts_tablet_manager.cc:1428] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260810 14:34:13.413537 20162 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:34:13.312340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:51001)
0810 14:34:13.313779 (+ 1439us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.313846 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:13.314987 (+ 1141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:13.412508 (+ 97521us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1175,"thread_start_us":157,"threads_started":1}
W20260810 14:34:13.414127 20160 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:39077 (0 consecutive failures): Network error: Failed to ping master at 127.1.206.126:39077: Client connection negotiation failed: client connection to 127.1.206.126:39077: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:34:13.414917 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.414615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:51429)
0810 14:34:13.414769 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.414849 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 14:34:13.415622 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.415394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:40023)
0810 14:34:13.415507 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.415561 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 14:34:13.415851 20160 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:34:13.441772 20163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:13.442034 20163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:13.442107 20163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:13.446292 20163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:13.446357 20163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:13.446444 20163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:34:13.451793 20163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:41617
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=35277
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:13.452934 20163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:13.454018 20163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:13.463699 20175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:13.463691 20172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:13.463685 20173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:13.463955 20163 server_base.cc:1034] running on GCE node
I20260810 14:34:13.464419 20163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:13.465031 20163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:13.466200 20163 hybrid_clock.cc:648] HybridClock initialized: now 1786372453466181 us; error 31 us; skew 500 ppm
Aug 10 14:34:13 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372453, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:13.468966 20163 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:34:13.469830 20163 webserver.cc:460] Webserver started at http://127.1.206.66:35277/ using document root <none> and password file <none>
I20260810 14:34:13.470379 20163 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:13.470469 20163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:13.474381 20163 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 14:34:13.476545 20183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.477779 20163 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:34:13.477921 20163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "8710a71cf0424287a51dd5602f098389"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "ec6b775f0f466d4122590b168648b417"
server_key_iv: "16bcc42fac4fdbf4a19fdc9f39a6be83"
server_key_version: "encryptionkey@0"
I20260810 14:34:13.478469 20163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:13.507180 20163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:13.510667 20163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:13.510883 20163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:13.511510 20163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:13.512418 20163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:13.512483 20163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.512552 20163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:13.512591 20163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.522297 20163 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:41617
I20260810 14:34:13.522353 20317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:41617 every 8 connection(s)
I20260810 14:34:13.523852 20163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:34:13.527787 20320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.526195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:49675)
0810 14:34:13.526884 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.527000 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":105,"threads_started":1}
W20260810 14:34:13.528400 20318 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:39077 (0 consecutive failures): Network error: Failed to ping master at 127.1.206.126:39077: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
I20260810 14:34:13.529081 20320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.528836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:50639)
0810 14:34:13.528964 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.529025 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 14:34:13.529803 20320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.529554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:49077)
0810 14:34:13.529670 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.529752 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 14:34:13.529987 20318 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 14:34:13.533250 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 20163
I20260810 14:34:13.533661 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:41017
--local_ip_for_outbound_sockets=127.1.206.67
--tserver_master_addrs=127.1.206.126:39077
--webserver_port=37459
--webserver_interface=127.1.206.67
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:13.647974 20321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:13.648313 20321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:13.648416 20321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:13.652506 20321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:13.652588 20321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:13.652674 20321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:34:13.658109 20321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:41017
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=37459
--tserver_master_addrs=127.1.206.126:39077
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:13.659273 20321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:13.660403 20321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:13.670475 20330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:13.670495 20328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:13.670495 20327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:13.670909 20321 server_base.cc:1034] running on GCE node
I20260810 14:34:13.671375 20321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:13.672034 20321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:13.673249 20321 hybrid_clock.cc:648] HybridClock initialized: now 1786372453673229 us; error 83 us; skew 500 ppm
Aug 10 14:34:13 dist-test-slave-0b58 krb5kdc[18635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372453, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:13.675915 20321 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:34:13.676821 20321 webserver.cc:460] Webserver started at http://127.1.206.67:37459/ using document root <none> and password file <none>
I20260810 14:34:13.677343 20321 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:13.677405 20321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:13.681286 20321 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:13.683538 20338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.684834 20321 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:13.684960 20321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "12108ad9bfb94308aadfca9d6540fefc"
format_stamp: "Formatted at 2026-08-10 14:33:31 on dist-test-slave-0b58"
server_key: "6faf49f740678ce6b457b38e01da9d7e"
server_key_iv: "6e8e635fc6f8002f4cc1915eabcba72d"
server_key_version: "encryptionkey@0"
I20260810 14:34:13.685531 20321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:13.699191 20321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:13.702883 20321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:13.703107 20321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:13.703751 20321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:13.704684 20321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:13.704735 20321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.704804 20321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:13.704839 20321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:13.714548 20321 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:41017
I20260810 14:34:13.714576 20466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:41017 every 8 connection(s)
I20260810 14:34:13.715684 20321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:34:13.719528 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.717871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:58997)
0810 14:34:13.718344 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.718813 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":120,"threads_started":1}
W20260810 14:34:13.719975 20467 heartbeater.cc:644] Failed to heartbeat to 127.1.206.126:39077 (0 consecutive failures): Network error: Failed to ping master at 127.1.206.126:39077: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
I20260810 14:34:13.720643 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.720416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:49783)
0810 14:34:13.720527 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.720580 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 14:34:13.721251 20469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:13.721030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:46499)
0810 14:34:13.721153 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:13.721203 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260810 14:34:13.721386 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 20321
W20260810 14:34:13.721490 20467 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 14:34:14.417276 20471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:14.416719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:53517)
0810 14:34:14.417020 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:14.417087 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":80,"threads_started":1}
I20260810 14:34:14.530999 20472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:14.530564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:39983)
0810 14:34:14.530832 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:14.530891 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":72,"threads_started":1}
I20260810 14:34:14.722517 20473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:14.722085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:36631)
0810 14:34:14.722335 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:14.722395 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":73,"threads_started":1}
I20260810 14:34:15.128841 20474 raft_consensus.cc:482] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:15.129172 20474 raft_consensus.cc:504] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:34:15.130403 20474 leader_election.cc:288] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617), 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
Aug 10 14:34:15 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372453, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.66@KRBTEST.COM
Aug 10 14:34:15 dist-test-slave-0b58 krb5kdc[18635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372453, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.67@KRBTEST.COM
I20260810 14:34:15.144802 20478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:15.130891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:59473 (local address 127.1.206.67:41017)
0810 14:34:15.131326 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:15.131357 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:15.131389 (+ 32us) server_negotiation.cc:407] Connection header received
0810 14:34:15.132028 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:15.132033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:15.132383 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:15.132688 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:15.134003 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.135209 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.136506 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.136988 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.137166 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:15.140247 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:15.140292 (+ 45us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:15.140312 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:15.140342 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:15.142246 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:15.142726 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:15.142732 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:15.142738 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:15.142891 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:15.143190 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:15.143192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:15.143193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:15.143578 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:15.143736 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:15.144340 (+ 604us) server_negotiation.cc:299] Negotiation successful
0810 14:34:15.144602 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":118,"threads_started":1}
I20260810 14:34:15.144833 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:15.130817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:60473 (local address 127.1.206.66:41617)
0810 14:34:15.131237 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:15.131249 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:15.131286 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:34:15.131956 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:15.131962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:15.132383 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:15.132689 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:15.134002 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.135232 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.136507 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.136984 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.137180 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:15.139943 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:15.139952 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:15.139970 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:15.140008 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:15.141933 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:15.142582 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:15.142588 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:15.142593 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:15.142766 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:15.143162 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:15.143166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:15.143170 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:15.143578 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:15.143756 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:15.144316 (+ 560us) server_negotiation.cc:299] Negotiation successful
0810 14:34:15.144620 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":65,"threads_started":1}
I20260810 14:34:15.144873 20476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:15.130708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:41017 (local address 127.1.206.65:59473)
0810 14:34:15.131091 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:15.131106 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:15.131216 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:15.132749 (+ 1533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:15.132755 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:15.133319 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:15.133818 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:15.133833 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.135364 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.135370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:15.136381 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:15.136391 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.137116 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.137120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:15.137311 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:15.138087 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:15.138099 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:15.140033 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:15.142370 (+ 2337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:15.142373 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:15.142374 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:15.142611 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:15.142993 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:15.142996 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:15.142997 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:15.143072 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:15.143712 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:15.143718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:15.143981 (+ 263us) client_negotiation.cc:769] Sending connection context
0810 14:34:15.144172 (+ 191us) client_negotiation.cc:240] Negotiation successful
0810 14:34:15.144671 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":308,"spinlock_wait_cycles":29696,"thread_start_us":89,"threads_started":1}
I20260810 14:34:15.144829 20475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:15.130635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:41617 (local address 127.1.206.65:60473)
0810 14:34:15.130973 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:15.130990 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:15.131103 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:15.132749 (+ 1646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:15.132755 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:15.133323 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:15.133817 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:15.133833 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.135361 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.135365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:15.136383 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:15.136394 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:15.137119 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:15.137123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:15.137308 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:15.138032 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:15.138048 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:15.139679 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:15.142071 (+ 2392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:15.142082 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:15.142097 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:15.142463 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:15.142863 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:15.142866 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:15.142867 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:15.143064 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:15.143722 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:15.143725 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:15.143983 (+ 258us) client_negotiation.cc:769] Sending connection context
0810 14:34:15.144175 (+ 192us) client_negotiation.cc:240] Negotiation successful
0810 14:34:15.144585 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":144,"spinlock_wait_cycles":30976,"thread_start_us":84,"threads_started":1}
W20260810 14:34:15.147622 20034 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
W20260810 14:34:15.147800 20033 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
I20260810 14:34:15.147926 20033 leader_election.cc:302] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91264e5226d4e8991dc672fec0963d2; no voters: 12108ad9bfb94308aadfca9d6540fefc, 8710a71cf0424287a51dd5602f098389
I20260810 14:34:15.148205 20474 raft_consensus.cc:2726] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:34:15.418650 20475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:15.418235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:41175)
0810 14:34:15.418467 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:15.418559 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260810 14:34:15.532420 20479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:15.531861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:43441)
0810 14:34:15.532156 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:15.532223 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":86,"threads_started":1}
I20260810 14:34:15.723702 20480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:15.723283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:36733)
0810 14:34:15.723551 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:15.723608 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":76,"threads_started":1}
I20260810 14:34:16.420169 20481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:16.419627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:54767)
0810 14:34:16.419951 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:16.420043 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":158,"threads_started":1}
I20260810 14:34:16.533731 20482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:16.533267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:33325)
0810 14:34:16.533564 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:16.533625 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":95,"threads_started":1}
I20260810 14:34:16.725308 20483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:16.724711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:59999)
0810 14:34:16.725083 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:16.725188 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":82,"threads_started":1}
I20260810 14:34:17.230297 20484 raft_consensus.cc:482] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:17.230448 20484 raft_consensus.cc:504] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:34:17.230973 20484 leader_election.cc:288] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617), 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
W20260810 14:34:17.231809 20033 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
W20260810 14:34:17.231904 20034 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
I20260810 14:34:17.232021 20034 leader_election.cc:302] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91264e5226d4e8991dc672fec0963d2; no voters: 12108ad9bfb94308aadfca9d6540fefc, 8710a71cf0424287a51dd5602f098389
I20260810 14:34:17.232226 20484 raft_consensus.cc:2726] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:34:17.421470 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:17.421006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:37543)
0810 14:34:17.421306 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:17.421371 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":82,"threads_started":1}
I20260810 14:34:17.535279 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:17.534618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:60641)
0810 14:34:17.535053 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:17.535131 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":107,"threads_started":1}
I20260810 14:34:17.726595 20488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:17.726146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:48777)
0810 14:34:17.726428 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:17.726488 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":80,"threads_started":1}
I20260810 14:34:18.423146 20489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:18.422559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:32897)
0810 14:34:18.422961 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:18.423036 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":106,"threads_started":1}
I20260810 14:34:18.536638 20490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:18.536187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:42293)
0810 14:34:18.536489 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:18.536545 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":130,"threads_started":1}
I20260810 14:34:18.727932 20491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:18.727498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:48101)
0810 14:34:18.727757 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:18.727838 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":82,"threads_started":1}
I20260810 14:34:19.424445 20492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:19.423983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:60831)
0810 14:34:19.424235 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:19.424346 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":80,"threads_started":1}
I20260810 14:34:19.537850 20493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:19.537412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:49871)
0810 14:34:19.537677 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:19.537744 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":77,"threads_started":1}
I20260810 14:34:19.616714 20494 raft_consensus.cc:482] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:19.616889 20494 raft_consensus.cc:504] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:34:19.617349 20494 leader_election.cc:288] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617), 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
W20260810 14:34:19.618336 20033 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
W20260810 14:34:19.618450 20034 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
I20260810 14:34:19.618515 20034 leader_election.cc:302] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91264e5226d4e8991dc672fec0963d2; no voters: 12108ad9bfb94308aadfca9d6540fefc, 8710a71cf0424287a51dd5602f098389
I20260810 14:34:19.618649 20494 raft_consensus.cc:2726] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:34:19.729341 20496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:19.728852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:41709)
0810 14:34:19.729143 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:19.729236 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":100,"threads_started":1}
I20260810 14:34:20.425786 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:20.425335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:45423)
0810 14:34:20.425607 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:20.425672 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":85,"threads_started":1}
I20260810 14:34:20.539125 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:20.538641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:39409)
0810 14:34:20.538956 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:20.539018 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":96,"threads_started":1}
I20260810 14:34:20.730743 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:20.730233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:38013)
0810 14:34:20.730573 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:20.730637 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":81,"threads_started":1}
I20260810 14:34:21.427039 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:21.426622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:36219)
0810 14:34:21.426883 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:21.426942 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":78,"threads_started":1}
I20260810 14:34:21.540481 20501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:21.539983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:59933)
0810 14:34:21.540319 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:21.540383 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":99,"threads_started":1}
I20260810 14:34:21.732088 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:21.731651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:51581)
0810 14:34:21.731930 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:21.731991 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":91,"threads_started":1}
I20260810 14:34:22.428485 20503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:22.427943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:53205)
0810 14:34:22.428241 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:22.428380 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":91,"threads_started":1}
I20260810 14:34:22.541770 20504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:22.541329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:40027)
0810 14:34:22.541608 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:22.541670 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
I20260810 14:34:22.733408 20505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:22.732911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:54761)
0810 14:34:22.733242 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:22.733308 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":81,"threads_started":1}
I20260810 14:34:23.429993 20506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:23.429530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:39415)
0810 14:34:23.429823 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:23.429892 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":80,"threads_started":1}
I20260810 14:34:23.543213 20508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:23.542731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:51799)
0810 14:34:23.543030 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:23.543106 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":91,"threads_started":1}
I20260810 14:34:23.734882 20509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:23.734339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:44983)
0810 14:34:23.734709 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:23.734778 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":101,"threads_started":1}
I20260810 14:34:24.349452 20510 raft_consensus.cc:482] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:24.349598 20510 raft_consensus.cc:504] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:34:24.350107 20510 leader_election.cc:288] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617), 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
W20260810 14:34:24.351197 20034 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
W20260810 14:34:24.351348 20033 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
I20260810 14:34:24.351416 20033 leader_election.cc:302] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91264e5226d4e8991dc672fec0963d2; no voters: 12108ad9bfb94308aadfca9d6540fefc, 8710a71cf0424287a51dd5602f098389
I20260810 14:34:24.351573 20510 raft_consensus.cc:2726] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:34:24.431507 20511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:24.431031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:56235)
0810 14:34:24.431340 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:24.431406 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":84,"threads_started":1}
I20260810 14:34:24.544685 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:24.544159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:59229)
0810 14:34:24.544514 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:24.544581 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":142,"threads_started":1}
I20260810 14:34:24.736495 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:24.735830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:40995)
0810 14:34:24.736150 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:24.736215 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":106,"threads_started":1}
I20260810 14:34:25.433025 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:25.432568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:35797)
0810 14:34:25.432856 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:25.432924 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":81,"threads_started":1}
I20260810 14:34:25.546001 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:25.545540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:56533)
0810 14:34:25.545845 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:25.545903 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":103,"threads_started":1}
I20260810 14:34:25.737818 20517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:25.737371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:51265)
0810 14:34:25.737661 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:25.737721 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":95,"threads_started":1}
I20260810 14:34:26.434525 20518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:26.434033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:40151)
0810 14:34:26.434356 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:26.434422 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":102,"threads_started":1}
I20260810 14:34:26.547400 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:26.546924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:35343)
0810 14:34:26.547195 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:26.547292 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":80,"threads_started":1}
I20260810 14:34:26.739121 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:26.738640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:54217)
0810 14:34:26.738951 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:26.739016 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":97,"threads_started":1}
I20260810 14:34:26.939173 20522 raft_consensus.cc:482] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:26.939368 20522 raft_consensus.cc:504] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8710a71cf0424287a51dd5602f098389" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41617 } } peers { permanent_uuid: "12108ad9bfb94308aadfca9d6540fefc" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41017 } } peers { permanent_uuid: "b91264e5226d4e8991dc672fec0963d2" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 34123 } }
I20260810 14:34:26.939819 20522 leader_election.cc:288] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617), 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017)
W20260810 14:34:26.940848 20033 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8710a71cf0424287a51dd5602f098389 (127.1.206.66:41617): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
W20260810 14:34:26.940979 20034 leader_election.cc:341] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 12108ad9bfb94308aadfca9d6540fefc (127.1.206.67:41017): Not found: Tablet not found: eca80976eec34c1ea3d22eebb404d3db
I20260810 14:34:26.941042 20034 leader_election.cc:302] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b91264e5226d4e8991dc672fec0963d2; no voters: 12108ad9bfb94308aadfca9d6540fefc, 8710a71cf0424287a51dd5602f098389
I20260810 14:34:26.941213 20522 raft_consensus.cc:2726] T eca80976eec34c1ea3d22eebb404d3db P b91264e5226d4e8991dc672fec0963d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:34:27.436100 20523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:27.435491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:38325)
0810 14:34:27.435775 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:27.435842 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":84,"threads_started":1}
I20260810 14:34:27.548692 20525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:27.548220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:35599)
0810 14:34:27.548539 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:27.548594 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":138,"threads_started":1}
I20260810 14:34:27.740468 20526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:27.739958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:49155)
0810 14:34:27.740246 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:27.740364 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":113,"threads_started":1}
I20260810 14:34:28.437577 20527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:28.437128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.65:39315)
0810 14:34:28.437419 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:28.437479 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":102,"threads_started":1}
I20260810 14:34:28.550060 20528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:28.549626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.66:44999)
0810 14:34:28.549899 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:28.549961 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":78,"threads_started":1}
I20260810 14:34:28.733136 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 19968
I20260810 14:34:28.742010 20529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:28.741564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39077 (local address 127.1.206.67:55263)
0810 14:34:28.741847 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:28.741911 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.126:39077: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":89,"threads_started":1}
I20260810 14:34:28.742986 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 20163
I20260810 14:34:28.751549 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 20321
2026-08-10T14:34:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59588 ms)
[----------] 30 tests from SecurityITest (248859 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:28 dist-test-slave-0b58 krb5kdc[20532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:28 dist-test-slave-0b58 krb5kdc[20532](info): set up 2 sockets
Aug 10 14:34:28 dist-test-slave-0b58 krb5kdc[20532](info): commencing operation
krb5kdc: starting...
W20260810 14:34:29.853367 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:29 dist-test-slave-0b58 krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:34:29.987977 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:38033
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:38033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:30.103075 20545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:30.103363 20545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:30.103405 20545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:30.108207 20545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:30.108312 20545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:30.108335 20545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:30.108352 20545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:30.108368 20545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:30.114272 20545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:38033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:38033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:30.115401 20545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:30.116556 20545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:30.125355 20551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:30.125360 20550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:30.125545 20545 server_base.cc:1034] running on GCE node
W20260810 14:34:30.125391 20553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:30.126262 20545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:30.127465 20545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:30.128630 20545 hybrid_clock.cc:648] HybridClock initialized: now 1786372470128605 us; error 38 us; skew 500 ppm
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372470, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:30.131630 20545 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:34:30.132607 20545 webserver.cc:460] Webserver started at http://127.1.206.126:40039/ using document root <none> and password file <none>
I20260810 14:34:30.133150 20545 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:30.133220 20545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:30.133404 20545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:30.135555 20545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "987f41c4729b4589aec2aaeca6185acc"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "779f8d94f6a8cca0097fcaa5f46de117"
server_key_iv: "e15be98e6951523f951bc6b89a9dbe65"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.136099 20545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "987f41c4729b4589aec2aaeca6185acc"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "779f8d94f6a8cca0097fcaa5f46de117"
server_key_iv: "e15be98e6951523f951bc6b89a9dbe65"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.139901 20545 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260810 14:34:30.142575 20562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.143884 20545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:34:30.144037 20545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "987f41c4729b4589aec2aaeca6185acc"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "779f8d94f6a8cca0097fcaa5f46de117"
server_key_iv: "e15be98e6951523f951bc6b89a9dbe65"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.144162 20545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:30.158154 20545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:30.161753 20545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:30.161983 20545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:30.169922 20545 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:38033
I20260810 14:34:30.169936 20621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:38033 every 8 connection(s)
I20260810 14:34:30.170981 20545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:30.173959 20622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:30.175489 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 20545
I20260810 14:34:30.175644 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:30.175988 1849 external_mini_cluster.cc:1428] Setting key 5db5a7bedc82e68a2355e08fde47cb3d
I20260810 14:34:30.181288 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc: Bootstrap starting.
I20260810 14:34:30.184033 20622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:30.184851 20622 log.cc:824] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:30.187244 20622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc: No bootstrap required, opened a new log
I20260810 14:34:30.192230 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.177531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44346 (local address 127.1.206.126:38033)
0810 14:34:30.177985 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:30.178004 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:30.178048 (+ 44us) server_negotiation.cc:407] Connection header received
0810 14:34:30.178909 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:30.178934 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:30.179377 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:30.179754 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:30.180543 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.181989 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.182878 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.183571 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.183736 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.186798 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:30.186805 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:30.186821 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:30.186853 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:30.188885 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.189338 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.189344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.189351 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.189502 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.189819 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.189822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.189825 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.190410 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:30.190611 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:30.190906 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 14:34:30.191225 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":121,"threads_started":1}
I20260810 14:34:30.192216 20622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987f41c4729b4589aec2aaeca6185acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38033 } }
I20260810 14:34:30.192555 20622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:30.192618 20622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987f41c4729b4589aec2aaeca6185acc, State: Initialized, Role: FOLLOWER
I20260810 14:34:30.193089 20622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987f41c4729b4589aec2aaeca6185acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38033 } }
I20260810 14:34:30.193246 20622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:30.193373 20622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:30.193487 20622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:30.194519 20622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987f41c4729b4589aec2aaeca6185acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38033 } }
I20260810 14:34:30.194883 20622 leader_election.cc:302] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987f41c4729b4589aec2aaeca6185acc; no voters:
I20260810 14:34:30.195217 20622 leader_election.cc:288] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:30.195447 20627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:30.195708 20627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [term 1 LEADER]: Becoming Leader. State: Replica: 987f41c4729b4589aec2aaeca6185acc, State: Running, Role: LEADER
I20260810 14:34:30.196025 20627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987f41c4729b4589aec2aaeca6185acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38033 } }
I20260810 14:34:30.196519 20622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:30.197695 20628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "987f41c4729b4589aec2aaeca6185acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987f41c4729b4589aec2aaeca6185acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38033 } } }
I20260810 14:34:30.197824 20628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:30.198210 20629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 987f41c4729b4589aec2aaeca6185acc. Latest consensus state: current_term: 1 leader_uuid: "987f41c4729b4589aec2aaeca6185acc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987f41c4729b4589aec2aaeca6185acc" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 38033 } } }
I20260810 14:34:30.198313 20629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:30.198529 20636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:30.201409 20636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:30.207409 20636 catalog_manager.cc:1347] Generated new cluster ID: 51c9e3c8a4e74b0eb34741a626ddf362
I20260810 14:34:30.207497 20636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:30.220082 20636 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:30.221513 20636 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:30.228344 20636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc: Generated new TSK 0
I20260810 14:34:30.229307 20636 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:34:30.265900 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38033
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:30.389019 20648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:30.389395 20648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:30.389477 20648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:30.393767 20648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:30.393867 20648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:30.393965 20648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:34:30.400007 20648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:30.401234 20648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:30.402302 20648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:30.412313 20658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:30.412307 20656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:30.412307 20654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:30.412475 20648 server_base.cc:1034] running on GCE node
I20260810 14:34:30.413018 20648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:30.413786 20648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:30.415001 20648 hybrid_clock.cc:648] HybridClock initialized: now 1786372470414978 us; error 39 us; skew 500 ppm
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372470, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:30.418366 20648 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:34:30.419400 20648 webserver.cc:460] Webserver started at http://127.1.206.65:41817/ using document root <none> and password file <none>
I20260810 14:34:30.420006 20648 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:30.420073 20648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:30.420372 20648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:30.422537 20648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "09ae7f355f69a434078a90a257c85df4"
server_key_iv: "cbd709f143bfa893dfe48d9f8a30ab7d"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.423139 20648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "09ae7f355f69a434078a90a257c85df4"
server_key_iv: "cbd709f143bfa893dfe48d9f8a30ab7d"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.427146 20648 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:34:30.429865 20666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.431160 20648 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:34:30.431325 20648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "09ae7f355f69a434078a90a257c85df4"
server_key_iv: "cbd709f143bfa893dfe48d9f8a30ab7d"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.431454 20648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:30.452000 20648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:30.455926 20648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:30.456221 20648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:30.456943 20648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:30.457875 20648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:30.457964 20648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.458060 20648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:30.458110 20648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.468292 20648 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:46473
I20260810 14:34:30.468345 20796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:46473 every 8 connection(s)
I20260810 14:34:30.469314 20648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:34:30.474617 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 20648
I20260810 14:34:30.474792 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:34:30.475132 1849 external_mini_cluster.cc:1428] Setting key 2384551f75438e1e2da0ba887de277de
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372470, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:34:30.487778 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.471277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:36349 (local address 127.1.206.126:38033)
0810 14:34:30.471447 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:30.471452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:30.472515 (+ 1063us) server_negotiation.cc:407] Connection header received
0810 14:34:30.473869 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:30.473873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:30.473931 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:30.474017 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:30.475867 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.476629 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.478577 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.478871 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.478981 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.482525 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:30.482529 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:30.482532 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:30.482565 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:30.484333 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.485430 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.485433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.485435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.485537 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.486111 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.486114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.486116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.486381 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:30.486477 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:30.487380 (+ 903us) server_negotiation.cc:299] Negotiation successful
0810 14:34:30.487582 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 14:34:30.488796 20799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.471763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:38033 (local address 127.1.206.65:36349)
0810 14:34:30.472339 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:30.472397 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:30.473608 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:30.474242 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:30.474251 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:30.474866 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:30.475652 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:30.475674 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.476790 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.476798 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:30.478313 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:30.478334 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.479081 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.479086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:30.479366 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.480089 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:30.480110 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:30.482210 (+ 2100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:30.484507 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:30.484517 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:30.484543 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:30.485109 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:30.485658 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:30.485663 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:30.485665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:30.485942 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:30.486528 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:30.486539 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:30.487008 (+ 469us) client_negotiation.cc:769] Sending connection context
0810 14:34:30.487289 (+ 281us) client_negotiation.cc:240] Negotiation successful
0810 14:34:30.487742 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:34:30.490259 20797 heartbeater.cc:347] Connected to a master server at 127.1.206.126:38033
I20260810 14:34:30.490573 20797 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:30.491274 20797 heartbeater.cc:511] Master 127.1.206.126:38033 requested a full tablet report, sending...
I20260810 14:34:30.493213 20581 ts_manager.cc:194] Registered new tserver with Master: bb2b5d937e254ffcaaa8783a6fd1f4c1 (127.1.206.65:46473)
I20260810 14:34:30.494454 20581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:36349
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:34:30.508324 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38033
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:30.636361 20803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:30.636672 20803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:30.636720 20803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:30.640938 20803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:30.641013 20803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:30.641076 20803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:34:30.646864 20803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:30.648080 20803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:30.649299 20803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:34:30.659941 20803 server_base.cc:1034] running on GCE node
W20260810 14:34:30.659857 20812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:30.659857 20808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:30.659857 20810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:30.660784 20803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:30.661501 20803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:30.662767 20803 hybrid_clock.cc:648] HybridClock initialized: now 1786372470662744 us; error 36 us; skew 500 ppm
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372470, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:30.665876 20803 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:34:30.666972 20803 webserver.cc:460] Webserver started at http://127.1.206.66:46293/ using document root <none> and password file <none>
I20260810 14:34:30.667606 20803 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:30.667706 20803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:30.667955 20803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:30.670265 20803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "0f39ab28839f44deb862dd961c32a3e6"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "e1ce0fa036ddd7406bb419e97ab5c62b"
server_key_iv: "0309ba2ff1979db61b1aacdc5b07a180"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.670907 20803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "0f39ab28839f44deb862dd961c32a3e6"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "e1ce0fa036ddd7406bb419e97ab5c62b"
server_key_iv: "0309ba2ff1979db61b1aacdc5b07a180"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.675105 20803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:30.678037 20819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.679494 20803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:34:30.679672 20803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "0f39ab28839f44deb862dd961c32a3e6"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "e1ce0fa036ddd7406bb419e97ab5c62b"
server_key_iv: "0309ba2ff1979db61b1aacdc5b07a180"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.679816 20803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:30.692214 20803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:30.696054 20803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:30.696563 20803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:30.697451 20803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:30.698588 20803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:30.698657 20803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.698704 20803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:30.698747 20803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.710743 20803 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:39591
I20260810 14:34:30.710743 20947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:39591 every 8 connection(s)
I20260810 14:34:30.711848 20803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:34:30.717453 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 20803
I20260810 14:34:30.717617 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:34:30.717988 1849 external_mini_cluster.cc:1428] Setting key cbe4258a1cf7fd6a419e33c3509fec01
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372470, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:34:30.730360 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.713952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:58789 (local address 127.1.206.126:38033)
0810 14:34:30.714151 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:30.714156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:30.715094 (+ 938us) server_negotiation.cc:407] Connection header received
0810 14:34:30.717235 (+ 2141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:30.717242 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:30.717324 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:30.717454 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:30.719221 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.719911 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.722118 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.722596 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.722765 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.726008 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:30.726015 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:30.726022 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:30.726064 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:30.727755 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.728472 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.728475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.728477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.728567 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.728983 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.728986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.728988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.729293 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:30.729417 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:30.730025 (+ 608us) server_negotiation.cc:299] Negotiation successful
0810 14:34:30.730172 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 14:34:30.731335 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.714357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:38033 (local address 127.1.206.66:58789)
0810 14:34:30.714908 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:30.714959 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:30.716866 (+ 1907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:30.717799 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:30.717808 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:30.718306 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:30.719005 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:30.719024 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.720090 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.720094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:30.721890 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:30.721910 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.722840 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.722844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:30.723026 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.723813 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:30.723842 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:30.725767 (+ 1925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:30.727919 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:30.727927 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:30.727949 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:30.728334 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:30.728687 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:30.728691 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:30.728693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:30.728866 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:30.729436 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:30.729446 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:30.729754 (+ 308us) client_negotiation.cc:769] Sending connection context
0810 14:34:30.729964 (+ 210us) client_negotiation.cc:240] Negotiation successful
0810 14:34:30.730400 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":140,"threads_started":1}
I20260810 14:34:30.732785 20949 heartbeater.cc:347] Connected to a master server at 127.1.206.126:38033
I20260810 14:34:30.733139 20949 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:34:30.733909 20949 heartbeater.cc:511] Master 127.1.206.126:38033 requested a full tablet report, sending...
I20260810 14:34:30.735320 20581 ts_manager.cc:194] Registered new tserver with Master: 0f39ab28839f44deb862dd961c32a3e6 (127.1.206.66:39591)
I20260810 14:34:30.736060 20581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:58789
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:34:30.753456 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38033
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:30.874578 20954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:30.874890 20954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:30.874936 20954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:30.879172 20954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:30.879254 20954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:30.879315 20954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:34:30.885147 20954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:38033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:30.886303 20954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:30.887321 20954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:34:30.898093 20954 server_base.cc:1034] running on GCE node
W20260810 14:34:30.898008 20960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:30.898001 20962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:30.898000 20959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:30.898782 20954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:30.899482 20954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:30.900686 20954 hybrid_clock.cc:648] HybridClock initialized: now 1786372470900649 us; error 56 us; skew 500 ppm
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372470, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:30.903839 20954 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:34:30.904899 20954 webserver.cc:460] Webserver started at http://127.1.206.67:32787/ using document root <none> and password file <none>
I20260810 14:34:30.905542 20954 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:30.905643 20954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:30.905901 20954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:30.908138 20954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "f11ef5fb3840d07761dfe990d367b8e0"
server_key_iv: "effef37334ef97e43360a18b9081edb9"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.908869 20954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "f11ef5fb3840d07761dfe990d367b8e0"
server_key_iv: "effef37334ef97e43360a18b9081edb9"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.913235 20954 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:34:30.916122 20969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.917668 20954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:30.917861 20954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe"
format_stamp: "Formatted at 2026-08-10 14:34:30 on dist-test-slave-0b58"
server_key: "f11ef5fb3840d07761dfe990d367b8e0"
server_key_iv: "effef37334ef97e43360a18b9081edb9"
server_key_version: "encryptionkey@0"
I20260810 14:34:30.918015 20954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:30.939553 20954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:30.943120 20954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:30.943362 20954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:30.944033 20954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:30.944977 20954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:30.945052 20954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.945134 20954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:30.945180 20954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:30.955075 20954 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:34473
I20260810 14:34:30.955109 21098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:34473 every 8 connection(s)
I20260810 14:34:30.956138 20954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:34:30.962486 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 20954
I20260810 14:34:30.962644 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:34:30.962985 1849 external_mini_cluster.cc:1428] Setting key db34dfd1126afa5d4bf5c3baf94d92ca
Aug 10 14:34:30 dist-test-slave-0b58 krb5kdc[20532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372470, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:30.972030 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.958295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:42415 (local address 127.1.206.126:38033)
0810 14:34:30.958459 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:30.958463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:30.959379 (+ 916us) server_negotiation.cc:407] Connection header received
0810 14:34:30.960831 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:30.960835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:30.960903 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:30.961012 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:30.962470 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.963169 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.964892 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.965255 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.965395 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.968207 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:30.968211 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:30.968215 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:30.968245 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:30.969757 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.970313 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.970315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.970317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.970430 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.970922 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.970925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.970926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.971153 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:30.971234 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:30.971785 (+ 551us) server_negotiation.cc:299] Negotiation successful
0810 14:34:30.971900 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 14:34:30.973062 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.958710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:38033 (local address 127.1.206.67:42415)
0810 14:34:30.959196 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:30.959253 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:30.960566 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:30.961218 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:30.961225 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:30.961636 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:30.962253 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:30.962279 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.963320 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.963324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:30.964731 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:30.964743 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.965425 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.965428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:30.965652 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.966364 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:30.966381 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:30.968016 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:30.969896 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:30.969902 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:30.969916 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:30.970217 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:30.970644 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:30.970647 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:30.970649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:30.970822 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:30.971263 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:30.971268 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:30.971542 (+ 274us) client_negotiation.cc:769] Sending connection context
0810 14:34:30.971731 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 14:34:30.972028 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":122,"threads_started":1}
I20260810 14:34:30.974473 21099 heartbeater.cc:347] Connected to a master server at 127.1.206.126:38033
I20260810 14:34:30.974772 21099 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:30.975322 21099 heartbeater.cc:511] Master 127.1.206.126:38033 requested a full tablet report, sending...
I20260810 14:34:30.976624 20581 ts_manager.cc:194] Registered new tserver with Master: f29dd5cc59a7499bbcb9b5534a3b9bbe (127.1.206.67:34473)
I20260810 14:34:30.977450 20581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:42415
I20260810 14:34:30.978039 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:34:30.989130 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:30.980343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47508 (local address 127.1.206.126:38033)
0810 14:34:30.980508 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:30.980513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:30.980666 (+ 153us) server_negotiation.cc:407] Connection header received
0810 14:34:30.980839 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:30.980842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:30.980894 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:30.980980 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:30.981814 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.982349 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.983259 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:30.983516 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:30.983645 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:30.985480 (+ 1835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:30.985483 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:30.985485 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:30.985515 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:30.987045 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.987632 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.987637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.987638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.987732 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:30.988055 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:30.988058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:30.988060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:30.988396 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:30.988546 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:30.988814 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 14:34:30.988947 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 14:34:30.992899 20580 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:34:30.996116 20580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:34:31.012586 21115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.006630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:34473 (local address 127.0.0.1:35816)
0810 14:34:31.007408 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.007420 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:31.007499 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:31.008188 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:31.008191 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:31.008217 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:31.008351 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.008359 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.009490 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.009496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.010866 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.010876 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.012016 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.012020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.012142 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.012194 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 14:34:31.012245 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 14:34:31.012412 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"mutex_wait_us":64,"thread_start_us":131,"threads_started":1}
I20260810 14:34:31.012651 21114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.006302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45738 (local address 127.1.206.65:46473)
0810 14:34:31.006729 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.006736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.007173 (+ 437us) server_negotiation.cc:407] Connection header received
0810 14:34:31.007380 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.007385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.007547 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.007646 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:31.008167 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.009317 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.011242 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.011808 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.011945 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.012118 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.012362 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.012490 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":133,"threads_started":1}
I20260810 14:34:31.012717 21111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.005842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:39591 (local address 127.0.0.1:50802)
0810 14:34:31.006572 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.006649 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:31.006787 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:31.007630 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:31.007636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:31.007658 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:31.007828 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.007835 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.009429 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.009435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.011078 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.011090 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.012155 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.012159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.012358 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.012382 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 14:34:31.012453 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 14:34:31.012524 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":254,"thread_start_us":92,"threads_started":1}
I20260810 14:34:31.012738 21113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.006004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50802 (local address 127.1.206.66:39591)
0810 14:34:31.007099 (+ 1095us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.007113 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.007140 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:34:31.007227 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.007233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.007447 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.007621 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:31.007959 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.009208 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.011224 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.012029 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.012217 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.012399 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.012484 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.012568 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":991,"thread_start_us":148,"threads_started":1}
I20260810 14:34:31.013465 21116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.007007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35816 (local address 127.1.206.67:34473)
0810 14:34:31.007758 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.007769 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.007794 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:34:31.007868 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.007876 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.008048 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.008196 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:31.008479 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.009288 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.010995 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.011862 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.013020 (+ 1158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.013189 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.013238 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.013328 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":145,"threads_started":1}
I20260810 14:34:31.013796 21112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.005854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:46473 (local address 127.0.0.1:45738)
0810 14:34:31.007053 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.007067 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:31.007245 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:31.007840 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:31.007842 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:31.007858 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:31.008006 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.008014 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.009690 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.009693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.011078 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.011090 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.011947 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.011951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.012079 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.012145 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 14:34:31.013422 (+ 1277us) client_negotiation.cc:240] Negotiation successful
0810 14:34:31.013506 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1136,"mutex_wait_us":60,"thread_start_us":94,"threads_started":1}
I20260810 14:34:31.016168 20719 tablet_service.cc:1467] Processing CreateTablet for tablet f93e26a2b62343f48fb8d14ec301223c (DEFAULT_TABLE table=test-table [id=ef7e9edaf01e472f8a838afa564c303d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:31.016122 21025 tablet_service.cc:1467] Processing CreateTablet for tablet f93e26a2b62343f48fb8d14ec301223c (DEFAULT_TABLE table=test-table [id=ef7e9edaf01e472f8a838afa564c303d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:31.016122 20872 tablet_service.cc:1467] Processing CreateTablet for tablet f93e26a2b62343f48fb8d14ec301223c (DEFAULT_TABLE table=test-table [id=ef7e9edaf01e472f8a838afa564c303d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:31.017331 21025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f93e26a2b62343f48fb8d14ec301223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:31.017328 20872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f93e26a2b62343f48fb8d14ec301223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:31.017330 20719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f93e26a2b62343f48fb8d14ec301223c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:31.024569 21117 tablet_bootstrap.cc:492] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1: Bootstrap starting.
I20260810 14:34:31.025880 21118 tablet_bootstrap.cc:492] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6: Bootstrap starting.
I20260810 14:34:31.027225 21117 tablet_bootstrap.cc:654] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:31.028234 21117 log.cc:824] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:31.028570 21118 tablet_bootstrap.cc:654] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:31.029150 21119 tablet_bootstrap.cc:492] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Bootstrap starting.
I20260810 14:34:31.029479 21118 log.cc:824] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:31.031360 21118 tablet_bootstrap.cc:492] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6: No bootstrap required, opened a new log
I20260810 14:34:31.031415 21117 tablet_bootstrap.cc:492] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1: No bootstrap required, opened a new log
I20260810 14:34:31.031404 21119 tablet_bootstrap.cc:654] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:31.031592 21118 ts_tablet_manager.cc:1397] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:34:31.031719 21117 ts_tablet_manager.cc:1397] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260810 14:34:31.032845 21119 log.cc:824] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:31.035202 21119 tablet_bootstrap.cc:492] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: No bootstrap required, opened a new log
I20260810 14:34:31.035408 21119 ts_tablet_manager.cc:1397] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:34:31.035158 21118 raft_consensus.cc:348] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.035943 21118 raft_consensus.cc:374] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:31.036006 21118 raft_consensus.cc:729] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f39ab28839f44deb862dd961c32a3e6, State: Initialized, Role: FOLLOWER
I20260810 14:34:31.036403 21117 raft_consensus.cc:348] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.036542 21118 consensus_queue.cc:260] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.036675 21117 raft_consensus.cc:374] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:31.036733 21117 raft_consensus.cc:729] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb2b5d937e254ffcaaa8783a6fd1f4c1, State: Initialized, Role: FOLLOWER
I20260810 14:34:31.037194 21117 consensus_queue.cc:260] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.037684 21118 ts_tablet_manager.cc:1428] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:34:31.037977 20797 heartbeater.cc:503] Master 127.1.206.126:38033 was elected leader, sending a full tablet report...
I20260810 14:34:31.038015 20949 heartbeater.cc:503] Master 127.1.206.126:38033 was elected leader, sending a full tablet report...
I20260810 14:34:31.038185 21117 ts_tablet_manager.cc:1428] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260810 14:34:31.040171 21119 raft_consensus.cc:348] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.040486 21119 raft_consensus.cc:374] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:31.040568 21119 raft_consensus.cc:729] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f29dd5cc59a7499bbcb9b5534a3b9bbe, State: Initialized, Role: FOLLOWER
I20260810 14:34:31.041060 21119 consensus_queue.cc:260] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.041764 21099 heartbeater.cc:503] Master 127.1.206.126:38033 was elected leader, sending a full tablet report...
I20260810 14:34:31.042171 21119 ts_tablet_manager.cc:1428] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 14:34:31.107028 21123 raft_consensus.cc:482] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:31.107250 21123 raft_consensus.cc:504] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.108421 21123 leader_election.cc:288] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb2b5d937e254ffcaaa8783a6fd1f4c1 (127.1.206.65:46473), f29dd5cc59a7499bbcb9b5534a3b9bbe (127.1.206.67:34473)
I20260810 14:34:31.113549 21116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.109184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:35285 (local address 127.1.206.67:34473)
0810 14:34:31.109336 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.109341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.109518 (+ 177us) server_negotiation.cc:407] Connection header received
0810 14:34:31.109619 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.109626 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.109694 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.109780 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:31.110104 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.110772 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.112146 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.112855 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.112990 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.113043 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.113333 (+ 290us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.113414 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 14:34:31.113549 21114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.108894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:49473 (local address 127.1.206.65:46473)
0810 14:34:31.109041 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.109048 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.109069 (+ 21us) server_negotiation.cc:407] Connection header received
0810 14:34:31.109141 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.109143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.109185 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.109296 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:31.109706 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.110491 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.112169 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.112865 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.112990 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.113043 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.113356 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.113430 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 14:34:31.113572 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.108721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:46473 (local address 127.1.206.66:49473)
0810 14:34:31.108873 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.108891 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:31.108999 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:31.109413 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:31.109417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:31.109439 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:31.109577 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.109587 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.110631 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.110634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.111943 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.111955 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.112992 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.112996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.113164 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.113208 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 14:34:31.113337 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 14:34:31.113397 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":11}
I20260810 14:34:31.113582 21128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.109016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:34473 (local address 127.1.206.66:35285)
0810 14:34:31.109424 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.109437 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:31.109526 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:31.109840 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:31.109843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:31.109863 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:31.109979 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.109984 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.110884 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.110887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.112016 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.112027 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.112992 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.112996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.113169 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.113210 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 14:34:31.113293 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:34:31.113387 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":74,"thread_start_us":172,"threads_started":1}
I20260810 14:34:31.114360 20743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93e26a2b62343f48fb8d14ec301223c" candidate_uuid: "0f39ab28839f44deb862dd961c32a3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" is_pre_election: true
I20260810 14:34:31.114537 21050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93e26a2b62343f48fb8d14ec301223c" candidate_uuid: "0f39ab28839f44deb862dd961c32a3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" is_pre_election: true
I20260810 14:34:31.114722 20743 raft_consensus.cc:2454] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f39ab28839f44deb862dd961c32a3e6 in term 0.
I20260810 14:34:31.114871 21050 raft_consensus.cc:2454] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f39ab28839f44deb862dd961c32a3e6 in term 0.
I20260810 14:34:31.115334 20823 leader_election.cc:302] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f39ab28839f44deb862dd961c32a3e6, bb2b5d937e254ffcaaa8783a6fd1f4c1; no voters:
I20260810 14:34:31.115690 21123 raft_consensus.cc:2781] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:34:31.115801 21123 raft_consensus.cc:482] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:34:31.115868 21123 raft_consensus.cc:3037] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:31.117044 21123 raft_consensus.cc:504] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.117440 21123 leader_election.cc:288] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [CANDIDATE]: Term 1 election: Requested vote from peers bb2b5d937e254ffcaaa8783a6fd1f4c1 (127.1.206.65:46473), f29dd5cc59a7499bbcb9b5534a3b9bbe (127.1.206.67:34473)
I20260810 14:34:31.118089 20743 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93e26a2b62343f48fb8d14ec301223c" candidate_uuid: "0f39ab28839f44deb862dd961c32a3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1"
I20260810 14:34:31.118252 21050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93e26a2b62343f48fb8d14ec301223c" candidate_uuid: "0f39ab28839f44deb862dd961c32a3e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe"
I20260810 14:34:31.118224 20743 raft_consensus.cc:3037] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:31.118425 21050 raft_consensus.cc:3037] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:31.119562 21050 raft_consensus.cc:2454] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f39ab28839f44deb862dd961c32a3e6 in term 1.
I20260810 14:34:31.119565 20743 raft_consensus.cc:2454] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f39ab28839f44deb862dd961c32a3e6 in term 1.
I20260810 14:34:31.119964 20823 leader_election.cc:302] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f39ab28839f44deb862dd961c32a3e6, f29dd5cc59a7499bbcb9b5534a3b9bbe; no voters:
I20260810 14:34:31.120203 21123 raft_consensus.cc:2781] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:31.120486 21123 raft_consensus.cc:686] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f39ab28839f44deb862dd961c32a3e6, State: Running, Role: LEADER
I20260810 14:34:31.120908 21123 consensus_queue.cc:237] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } }
I20260810 14:34:31.124619 20580 catalog_manager.cc:5495] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f39ab28839f44deb862dd961c32a3e6 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "0f39ab28839f44deb862dd961c32a3e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f39ab28839f44deb862dd961c32a3e6" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 39591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 } health_report { overall_health: UNKNOWN } } }
I20260810 14:34:31.138382 21113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.134337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50814 (local address 127.1.206.66:39591)
0810 14:34:31.134508 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.134512 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.134529 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:34:31.134612 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.134614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.134675 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.134841 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:34:31.135168 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.135735 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.136755 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.136981 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.137095 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.137446 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:34:31.137922 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:34:31.138064 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.138126 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.138193 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:34:31.144899 21050 raft_consensus.cc:1261] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 1 FOLLOWER]: Refusing update from remote peer 0f39ab28839f44deb862dd961c32a3e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:31.144907 20743 raft_consensus.cc:1261] T f93e26a2b62343f48fb8d14ec301223c P bb2b5d937e254ffcaaa8783a6fd1f4c1 [term 1 FOLLOWER]: Refusing update from remote peer 0f39ab28839f44deb862dd961c32a3e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:31.145697 21129 consensus_queue.cc:1035] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f29dd5cc59a7499bbcb9b5534a3b9bbe" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:31.145936 21123 consensus_queue.cc:1035] T f93e26a2b62343f48fb8d14ec301223c P 0f39ab28839f44deb862dd961c32a3e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb2b5d937e254ffcaaa8783a6fd1f4c1" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:31.154686 21138 mvcc.cc:205] Tried to move back new op lower bound from 7316981641801289728 to 7316981641714147328. Current Snapshot: MvccSnapshot[applied={T|T < 7316981641801289728}]
I20260810 14:34:31.156514 21137 mvcc.cc:205] Tried to move back new op lower bound from 7316981641801289728 to 7316981641714147328. Current Snapshot: MvccSnapshot[applied={T|T < 7316981641801289728}]
I20260810 14:34:31.164855 20579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:31.165091 20579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:31.167927 20579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 987f41c4729b4589aec2aaeca6185acc: Sending DeleteTablet for 3 replicas of tablet f93e26a2b62343f48fb8d14ec301223c
I20260810 14:34:31.169101 20719 tablet_service.cc:1514] Processing DeleteTablet for tablet f93e26a2b62343f48fb8d14ec301223c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:45738
I20260810 14:34:31.169104 20872 tablet_service.cc:1514] Processing DeleteTablet for tablet f93e26a2b62343f48fb8d14ec301223c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:50802
I20260810 14:34:31.169970 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 20648
I20260810 14:34:31.169916 21025 tablet_service.cc:1514] Processing DeleteTablet for tablet f93e26a2b62343f48fb8d14ec301223c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:31 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:35816
I20260810 14:34:31.175740 21148 tablet_replica.cc:330] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: stopping tablet replica
I20260810 14:34:31.176242 21148 raft_consensus.cc:2229] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:31.176815 21148 raft_consensus.cc:2258] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:31.178807 21148 ts_tablet_manager.cc:1905] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 14:34:31.180455 20566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:46473 (error 108)
I20260810 14:34:31.181512 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 20803
I20260810 14:34:31.184528 21148 ts_tablet_manager.cc:1918] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:31.184682 21148 log.cc:1196] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/f93e26a2b62343f48fb8d14ec301223c
I20260810 14:34:31.185048 21148 ts_tablet_manager.cc:1939] T f93e26a2b62343f48fb8d14ec301223c P f29dd5cc59a7499bbcb9b5534a3b9bbe: Deleting consensus metadata
I20260810 14:34:31.186604 21112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.186131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:46473 (local address 127.0.0.1:45750)
0810 14:34:31.186392 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.186487 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:46473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260810 14:34:31.187453 20566 catalog_manager.cc:4584] TS bb2b5d937e254ffcaaa8783a6fd1f4c1 (127.1.206.65:46473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f93e26a2b62343f48fb8d14ec301223c: Network error: Client connection negotiation failed: client connection to 127.1.206.65:46473: connect: Connection refused (error 111)
I20260810 14:34:31.187831 20566 catalog_manager.cc:4841] TS f29dd5cc59a7499bbcb9b5534a3b9bbe (127.1.206.67:34473): tablet f93e26a2b62343f48fb8d14ec301223c (table test-table [id=ef7e9edaf01e472f8a838afa564c303d]) successfully deleted
I20260810 14:34:31.192109 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 20954
I20260810 14:34:31.195976 21112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.191983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:39591 (local address 127.0.0.1:50820)
0810 14:34:31.192124 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.192212 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.66:39591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 14:34:31.201403 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 20545
2026-08-10T14:34:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2452 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T14:34:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:31Z Disabled control of system clock
I20260810 14:34:31.240226 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34989
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:45337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:34989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:34:31.362475 21154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:31.362793 21154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:31.362831 21154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:31.367223 21154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:31.367304 21154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:31.367319 21154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:31.367337 21154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:31.367353 21154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:31.372498 21154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:34989
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:31.373699 21154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:31.375306 21154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:34:31.385147 21154 server_base.cc:1034] running on GCE node
W20260810 14:34:31.385097 21159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:31.385083 21160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:31.385113 21162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:31.386214 21154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:31.387413 21154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:31.388609 21154 hybrid_clock.cc:648] HybridClock initialized: now 1786372471388595 us; error 30 us; skew 500 ppm
I20260810 14:34:31.390698 21154 webserver.cc:460] Webserver started at http://127.1.206.126:44519/ using document root <none> and password file <none>
I20260810 14:34:31.391281 21154 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:31.391348 21154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:31.391520 21154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:31.393754 21154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "afdd6406a28b4dbfb596c3659f66ae21"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "5b8ea9d79cc5abb40f40b278c3fc9378"
server_key_iv: "05730ef3126894769547373fd498aaac"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.394330 21154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "afdd6406a28b4dbfb596c3659f66ae21"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "5b8ea9d79cc5abb40f40b278c3fc9378"
server_key_iv: "05730ef3126894769547373fd498aaac"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.398340 21154 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:31.401175 21168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:31.402733 21154 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:31.402895 21154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "afdd6406a28b4dbfb596c3659f66ae21"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "5b8ea9d79cc5abb40f40b278c3fc9378"
server_key_iv: "05730ef3126894769547373fd498aaac"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.403023 21154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:31.424115 21154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:31.425034 21154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:31.425238 21154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:31.433966 21154 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:34989
I20260810 14:34:31.433979 21226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:34989 every 8 connection(s)
I20260810 14:34:31.435104 21154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:31.438586 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 21154
I20260810 14:34:31.438752 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:31.439124 1849 external_mini_cluster.cc:1428] Setting key 71a483fdb6ef819e256a9852e9d6b952
I20260810 14:34:31.439198 21227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:31.446969 21227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21: Bootstrap starting.
I20260810 14:34:31.449856 21227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:31.449903 21230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.440851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41614 (local address 127.1.206.126:34989)
0810 14:34:31.441646 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.441663 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.441703 (+ 40us) server_negotiation.cc:407] Connection header received
0810 14:34:31.442570 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.442595 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.443050 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.443487 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:31.443964 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.445114 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.446105 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.446637 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.446830 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.447902 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:31.447907 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:31.447921 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:31.448448 (+ 527us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:31.448518 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:31.448541 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:31.448666 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.448824 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.449117 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":203,"threads_started":1}
I20260810 14:34:31.451198 21227 log.cc:824] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:31.453929 21227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21: No bootstrap required, opened a new log
I20260810 14:34:31.457849 21227 raft_consensus.cc:348] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdd6406a28b4dbfb596c3659f66ae21" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34989 } }
I20260810 14:34:31.458189 21227 raft_consensus.cc:374] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:31.458299 21227 raft_consensus.cc:729] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afdd6406a28b4dbfb596c3659f66ae21, State: Initialized, Role: FOLLOWER
I20260810 14:34:31.458971 21227 consensus_queue.cc:260] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdd6406a28b4dbfb596c3659f66ae21" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34989 } }
I20260810 14:34:31.459111 21227 raft_consensus.cc:388] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:31.459165 21227 raft_consensus.cc:482] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:31.459306 21227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:31.460505 21227 raft_consensus.cc:504] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdd6406a28b4dbfb596c3659f66ae21" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34989 } }
I20260810 14:34:31.460917 21227 leader_election.cc:302] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afdd6406a28b4dbfb596c3659f66ae21; no voters:
I20260810 14:34:31.461324 21227 leader_election.cc:288] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:31.461413 21232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:31.461658 21232 raft_consensus.cc:686] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [term 1 LEADER]: Becoming Leader. State: Replica: afdd6406a28b4dbfb596c3659f66ae21, State: Running, Role: LEADER
I20260810 14:34:31.461997 21232 consensus_queue.cc:237] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdd6406a28b4dbfb596c3659f66ae21" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34989 } }
I20260810 14:34:31.462857 21227 sys_catalog.cc:564] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:31.463923 21234 sys_catalog.cc:455] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afdd6406a28b4dbfb596c3659f66ae21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdd6406a28b4dbfb596c3659f66ae21" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34989 } } }
I20260810 14:34:31.464090 21234 sys_catalog.cc:458] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:31.464412 21233 sys_catalog.cc:455] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afdd6406a28b4dbfb596c3659f66ae21. Latest consensus state: current_term: 1 leader_uuid: "afdd6406a28b4dbfb596c3659f66ae21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdd6406a28b4dbfb596c3659f66ae21" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34989 } } }
I20260810 14:34:31.464519 21233 sys_catalog.cc:458] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:31.464794 21242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:31.468626 21242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:31.475536 21242 catalog_manager.cc:1347] Generated new cluster ID: 6891526a1aa84483a4b68e8d540ece26
I20260810 14:34:31.475646 21242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:31.494349 21242 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:31.495726 21242 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:31.506877 21242 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21: Generated new TSK 0
I20260810 14:34:31.507723 21242 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:31.518819 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34989
--builtin_ntp_servers=127.1.206.84:45337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:34:31.646400 21254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:31.646713 21254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:31.646754 21254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:31.651175 21254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:31.651261 21254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:31.651322 21254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:34:31.656605 21254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:31.657883 21254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:31.659380 21254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:31.670208 21259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:31.670204 21262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:31.670249 21254 server_base.cc:1034] running on GCE node
W20260810 14:34:31.670204 21260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:31.670998 21254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:31.671754 21254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:31.672968 21254 hybrid_clock.cc:648] HybridClock initialized: now 1786372471672952 us; error 40 us; skew 500 ppm
I20260810 14:34:31.675137 21254 webserver.cc:460] Webserver started at http://127.1.206.65:39191/ using document root <none> and password file <none>
I20260810 14:34:31.675789 21254 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:31.675892 21254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:31.676138 21254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:31.678403 21254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "b398ba8b025448ccb9909677ca613947"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "8db7d3e671b3564b6ab3e1c7cda8fc6a"
server_key_iv: "d980c32e66e67f3a84ab8d463cfbcb88"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.679037 21254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "b398ba8b025448ccb9909677ca613947"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "8db7d3e671b3564b6ab3e1c7cda8fc6a"
server_key_iv: "d980c32e66e67f3a84ab8d463cfbcb88"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.683120 21254 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:34:31.685909 21270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:31.687259 21254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:34:31.687417 21254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "b398ba8b025448ccb9909677ca613947"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "8db7d3e671b3564b6ab3e1c7cda8fc6a"
server_key_iv: "d980c32e66e67f3a84ab8d463cfbcb88"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.687552 21254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:31.705158 21254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:31.706025 21254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:31.706292 21254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:31.706971 21254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:31.708089 21254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:31.708170 21254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:31.708287 21254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:31.708330 21254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260810 14:34:31.718220 21254 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:33433
I20260810 14:34:31.718247 21394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:33433 every 8 connection(s)
I20260810 14:34:31.719308 21254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:34:31.727833 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 21254
I20260810 14:34:31.728101 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:34:31.728474 1849 external_mini_cluster.cc:1428] Setting key a79df9cc5b997c614099cbede782d640
I20260810 14:34:31.730898 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34989
--builtin_ntp_servers=127.1.206.84:45337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:34:31.730954 21230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.721711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:46167 (local address 127.1.206.126:34989)
0810 14:34:31.721927 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.721933 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.723111 (+ 1178us) server_negotiation.cc:407] Connection header received
0810 14:34:31.724647 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.724650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.724703 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.724811 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:31.726111 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.726738 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.728231 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.728625 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.728780 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.730317 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:31.730321 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:31.730324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:31.730338 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:31.730365 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:31.730375 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:31.730458 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.730679 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.730792 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260810 14:34:31.731995 21397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.722121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34989 (local address 127.1.206.65:46167)
0810 14:34:31.722929 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.722980 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:31.724392 (+ 1412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:31.725057 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:31.725065 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:31.725272 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:31.725874 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.725890 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.726909 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.726918 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.727977 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.727999 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.728841 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.728850 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.729102 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.729947 (+ 845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:31.729949 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:31.730021 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:31.730128 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:31.730501 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:31.730511 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:31.730517 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:34:31.730646 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 14:34:31.730931 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":173,"threads_started":1}
I20260810 14:34:31.733626 21395 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34989
I20260810 14:34:31.733948 21395 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:31.734609 21395 heartbeater.cc:511] Master 127.1.206.126:34989 requested a full tablet report, sending...
I20260810 14:34:31.736596 21187 ts_manager.cc:194] Registered new tserver with Master: b398ba8b025448ccb9909677ca613947 (127.1.206.65:33433)
I20260810 14:34:31.737905 21187 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.65:46167
W20260810 14:34:31.854126 21399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:31.854455 21399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:31.854498 21399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:31.858966 21399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:31.859050 21399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:31.859112 21399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:34:31.864598 21399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:31.865880 21399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:31.867381 21399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:31.877775 21409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:31.877730 21405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:31.877744 21404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:31.878190 21399 server_base.cc:1034] running on GCE node
I20260810 14:34:31.878696 21399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:31.879398 21399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:31.880627 21399 hybrid_clock.cc:648] HybridClock initialized: now 1786372471880581 us; error 62 us; skew 500 ppm
I20260810 14:34:31.882714 21399 webserver.cc:460] Webserver started at http://127.1.206.66:44831/ using document root <none> and password file <none>
I20260810 14:34:31.883348 21399 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:31.883446 21399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:31.883724 21399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:31.886018 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "724cefc055c94ea083408f8baa24dc0c"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "4c0769a9a8b294e870489b9f5773aeac"
server_key_iv: "e9f7f27bfe5c232ea8231e9ed2628631"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.886682 21399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "724cefc055c94ea083408f8baa24dc0c"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "4c0769a9a8b294e870489b9f5773aeac"
server_key_iv: "e9f7f27bfe5c232ea8231e9ed2628631"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.890827 21399 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:31.893815 21416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:31.895153 21399 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:34:31.895409 21399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "724cefc055c94ea083408f8baa24dc0c"
format_stamp: "Formatted at 2026-08-10 14:34:31 on dist-test-slave-0b58"
server_key: "4c0769a9a8b294e870489b9f5773aeac"
server_key_iv: "e9f7f27bfe5c232ea8231e9ed2628631"
server_key_version: "encryptionkey@0"
I20260810 14:34:31.895556 21399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:31.915589 21399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:31.916580 21399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:31.916822 21399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:31.917495 21399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:31.918551 21399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:31.918641 21399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:31.918716 21399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:31.918769 21399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:31.928586 21399 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:41093
I20260810 14:34:31.928611 21541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:41093 every 8 connection(s)
I20260810 14:34:31.929703 21399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:34:31.930840 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 21399
I20260810 14:34:31.930946 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:34:31.931262 1849 external_mini_cluster.cc:1428] Setting key 662d43838298bec25a62b1b57d598486
I20260810 14:34:31.933568 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34989
--builtin_ntp_servers=127.1.206.84:45337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:34:31.940577 21230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.931862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:39497 (local address 127.1.206.126:34989)
0810 14:34:31.932051 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:31.932056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:31.933437 (+ 1381us) server_negotiation.cc:407] Connection header received
0810 14:34:31.934955 (+ 1518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:31.934961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:31.935032 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:31.935133 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:31.936535 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.937085 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.938343 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.938588 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.938714 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.939993 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:31.939997 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:31.939999 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:31.940013 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:31.940035 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:31.940043 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:31.940126 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:31.940346 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 14:34:31.940418 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 14:34:31.941532 21545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:31.932446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34989 (local address 127.1.206.66:39497)
0810 14:34:31.933246 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:31.933306 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:31.934706 (+ 1400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:31.935362 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:31.935374 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:31.935503 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:31.936329 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.936357 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.937216 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.937219 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.938190 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:31.938200 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:31.938762 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:31.938776 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:31.938956 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:31.939669 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:31.939670 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:31.939714 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:31.939809 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:31.940129 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:31.940142 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:31.940151 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 14:34:31.940333 (+ 182us) client_negotiation.cc:240] Negotiation successful
0810 14:34:31.940656 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":158,"threads_started":1}
I20260810 14:34:31.942875 21543 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34989
I20260810 14:34:31.943148 21543 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:31.943727 21543 heartbeater.cc:511] Master 127.1.206.126:34989 requested a full tablet report, sending...
I20260810 14:34:31.944947 21187 ts_manager.cc:194] Registered new tserver with Master: 724cefc055c94ea083408f8baa24dc0c (127.1.206.66:41093)
I20260810 14:34:31.945873 21187 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.66:39497
W20260810 14:34:32.062999 21546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:32.063304 21546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:32.063347 21546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:32.067981 21546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:32.068056 21546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:32.068123 21546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:34:32.073349 21546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:32.074678 21546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:32.076151 21546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:32.086512 21554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:32.086508 21553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:32.086550 21556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:32.086709 21546 server_base.cc:1034] running on GCE node
I20260810 14:34:32.087265 21546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:32.088007 21546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:32.089305 21546 hybrid_clock.cc:648] HybridClock initialized: now 1786372472089188 us; error 55 us; skew 500 ppm
I20260810 14:34:32.091727 21546 webserver.cc:460] Webserver started at http://127.1.206.67:45995/ using document root <none> and password file <none>
I20260810 14:34:32.092522 21546 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:32.092635 21546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:32.092885 21546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:32.095263 21546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "e690fec036984796826774fbcd569742"
format_stamp: "Formatted at 2026-08-10 14:34:32 on dist-test-slave-0b58"
server_key: "7fdbe9d10f6a1d0c8f7bbba2a9590568"
server_key_iv: "d98133c84504f7c8a223f71ed8eb7408"
server_key_version: "encryptionkey@0"
I20260810 14:34:32.095948 21546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "e690fec036984796826774fbcd569742"
format_stamp: "Formatted at 2026-08-10 14:34:32 on dist-test-slave-0b58"
server_key: "7fdbe9d10f6a1d0c8f7bbba2a9590568"
server_key_iv: "d98133c84504f7c8a223f71ed8eb7408"
server_key_version: "encryptionkey@0"
I20260810 14:34:32.100482 21546 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:34:32.103477 21564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:32.104838 21546 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:32.104996 21546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "e690fec036984796826774fbcd569742"
format_stamp: "Formatted at 2026-08-10 14:34:32 on dist-test-slave-0b58"
server_key: "7fdbe9d10f6a1d0c8f7bbba2a9590568"
server_key_iv: "d98133c84504f7c8a223f71ed8eb7408"
server_key_version: "encryptionkey@0"
I20260810 14:34:32.105141 21546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:32.117429 21546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:32.118224 21546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:32.118446 21546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:32.119092 21546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:32.120425 21546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:32.120499 21546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:32.120579 21546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:32.120622 21546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:32.131146 21546 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:39023
I20260810 14:34:32.131170 21692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:39023 every 8 connection(s)
I20260810 14:34:32.132215 21546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:34:32.132998 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 21546
I20260810 14:34:32.133116 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:34:32.133420 1849 external_mini_cluster.cc:1428] Setting key 55f1c3fb25403726a551918883732f42
I20260810 14:34:32.142937 21230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.134501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:53423 (local address 127.1.206.126:34989)
0810 14:34:32.134651 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.134655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.136192 (+ 1537us) server_negotiation.cc:407] Connection header received
0810 14:34:32.137703 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.137706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.137758 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.137836 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:32.138783 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.139362 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.140739 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.140986 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.141080 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.142352 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:32.142355 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:32.142357 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:32.142405 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:32.142428 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:32.142437 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:32.142519 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.142732 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.142806 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 14:34:32.143904 21695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.135019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:34989 (local address 127.1.206.67:53423)
0810 14:34:32.136037 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:32.136095 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:32.137473 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:32.138011 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:32.138019 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:32.138107 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:32.138626 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.138640 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.139502 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.139506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.140599 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.140611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.141152 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.141155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.141323 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.142028 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:32.142030 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:32.142078 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:32.142157 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:32.142551 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:32.142560 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:32.142565 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:34:32.142674 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 14:34:32.142948 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":160,"threads_started":1}
I20260810 14:34:32.145243 21693 heartbeater.cc:347] Connected to a master server at 127.1.206.126:34989
I20260810 14:34:32.145548 21693 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:32.146203 21693 heartbeater.cc:511] Master 127.1.206.126:34989 requested a full tablet report, sending...
I20260810 14:34:32.147464 21187 ts_manager.cc:194] Registered new tserver with Master: e690fec036984796826774fbcd569742 (127.1.206.67:39023)
I20260810 14:34:32.147979 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:34:32.148149 21187 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.67:53423
I20260810 14:34:32.154421 21230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.150312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.1.206.126:34989)
0810 14:34:32.150457 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.150462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.150658 (+ 196us) server_negotiation.cc:407] Connection header received
0810 14:34:32.150747 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.150749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.150790 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.150860 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:32.151229 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.151781 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.152767 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.152984 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.153065 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.153858 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:32.153862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:32.153864 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:32.153877 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:32.153897 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:32.153904 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:32.153964 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.154149 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.154208 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:34:32.157836 21187 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:34:32.161091 21187 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:34:32.177676 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.171186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42000 (local address 127.1.206.65:33433)
0810 14:34:32.171627 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.171640 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.171998 (+ 358us) server_negotiation.cc:407] Connection header received
0810 14:34:32.172072 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.172077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.172221 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.172383 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:32.174131 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.175184 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.176411 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.177031 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.177147 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.177344 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.177399 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.177510 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":129,"threads_started":1}
I20260810 14:34:32.177805 21708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.170432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46084 (local address 127.1.206.66:41093)
0810 14:34:32.170811 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.170827 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.171621 (+ 794us) server_negotiation.cc:407] Connection header received
0810 14:34:32.171937 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.171946 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.172168 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.172362 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:32.172704 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.173966 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.176054 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.176810 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.176900 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.177063 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.177515 (+ 452us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.177617 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":178,"threads_started":1}
I20260810 14:34:32.178073 21707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.170275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:41093 (local address 127.0.0.1:46084)
0810 14:34:32.171454 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:32.171516 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:32.171728 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:32.172345 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:32.172351 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:32.172374 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:32.172557 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.172565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.174099 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.174103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.175906 (+ 1803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.175918 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.176945 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.176949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.177074 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.177138 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 14:34:32.177253 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 14:34:32.177397 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"mutex_wait_us":181,"spinlock_wait_cycles":768,"thread_start_us":108,"threads_started":1}
I20260810 14:34:32.178514 21709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.171024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:33433 (local address 127.0.0.1:42000)
0810 14:34:32.171771 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:32.171785 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:32.171904 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:32.172528 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:32.172531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:32.172560 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:32.172739 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.172746 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.175307 (+ 2561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.175313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.176284 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.176296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.177171 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.177183 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.177273 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.177297 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 14:34:32.177361 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 14:34:32.177432 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":90,"spinlock_wait_cycles":4480,"thread_start_us":109,"threads_started":1}
I20260810 14:34:32.179054 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.170301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:39023 (local address 127.0.0.1:45736)
0810 14:34:32.171453 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:32.171515 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:32.171652 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:32.172529 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:32.172532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:32.172554 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:32.172746 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.172752 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.174099 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.174103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.175909 (+ 1806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.175918 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.178616 (+ 2698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.178619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.178739 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.178765 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 14:34:32.178847 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 14:34:32.178926 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":969,"mutex_wait_us":250,"spinlock_wait_cycles":34048,"thread_start_us":99,"threads_started":1}
I20260810 14:34:32.179376 21712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.171162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45736 (local address 127.1.206.67:39023)
0810 14:34:32.172052 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.172067 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.172091 (+ 24us) server_negotiation.cc:407] Connection header received
0810 14:34:32.172164 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.172171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.172393 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.172544 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:32.172867 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.173966 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.177155 (+ 3189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.178257 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.178362 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.178545 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.178899 (+ 354us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.179009 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":155,"threads_started":1}
I20260810 14:34:32.181453 21467 tablet_service.cc:1467] Processing CreateTablet for tablet 796b6f7fb3f54d44b08a3ac21da30159 (DEFAULT_TABLE table=test-table [id=3785e029d58e4046b0ab1c3afda5b309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:32.181527 21324 tablet_service.cc:1467] Processing CreateTablet for tablet 796b6f7fb3f54d44b08a3ac21da30159 (DEFAULT_TABLE table=test-table [id=3785e029d58e4046b0ab1c3afda5b309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:32.181959 21620 tablet_service.cc:1467] Processing CreateTablet for tablet 796b6f7fb3f54d44b08a3ac21da30159 (DEFAULT_TABLE table=test-table [id=3785e029d58e4046b0ab1c3afda5b309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:32.182696 21467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 796b6f7fb3f54d44b08a3ac21da30159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:32.182698 21324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 796b6f7fb3f54d44b08a3ac21da30159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:32.182879 21620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 796b6f7fb3f54d44b08a3ac21da30159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:32.189596 21713 tablet_bootstrap.cc:492] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Bootstrap starting.
I20260810 14:34:32.191166 21714 tablet_bootstrap.cc:492] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: Bootstrap starting.
I20260810 14:34:32.192461 21713 tablet_bootstrap.cc:654] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:32.192800 21715 tablet_bootstrap.cc:492] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Bootstrap starting.
I20260810 14:34:32.193413 21713 log.cc:824] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:32.193608 21714 tablet_bootstrap.cc:654] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:32.194410 21714 log.cc:824] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:32.195050 21715 tablet_bootstrap.cc:654] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:32.195741 21715 log.cc:824] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:32.196343 21713 tablet_bootstrap.cc:492] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: No bootstrap required, opened a new log
I20260810 14:34:32.196561 21713 ts_tablet_manager.cc:1397] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260810 14:34:32.196652 21714 tablet_bootstrap.cc:492] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: No bootstrap required, opened a new log
I20260810 14:34:32.196851 21714 ts_tablet_manager.cc:1397] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:34:32.197582 21715 tablet_bootstrap.cc:492] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: No bootstrap required, opened a new log
I20260810 14:34:32.197794 21715 ts_tablet_manager.cc:1397] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 14:34:32.201222 21713 raft_consensus.cc:348] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.201222 21714 raft_consensus.cc:348] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.201535 21714 raft_consensus.cc:374] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:32.201535 21713 raft_consensus.cc:374] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:32.201597 21713 raft_consensus.cc:729] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 724cefc055c94ea083408f8baa24dc0c, State: Initialized, Role: FOLLOWER
I20260810 14:34:32.201607 21714 raft_consensus.cc:729] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b398ba8b025448ccb9909677ca613947, State: Initialized, Role: FOLLOWER
I20260810 14:34:32.201529 21715 raft_consensus.cc:348] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.201836 21715 raft_consensus.cc:374] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:32.202133 21715 raft_consensus.cc:729] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e690fec036984796826774fbcd569742, State: Initialized, Role: FOLLOWER
I20260810 14:34:32.202124 21713 consensus_queue.cc:260] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.202124 21714 consensus_queue.cc:260] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.202572 21715 consensus_queue.cc:260] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.202967 21395 heartbeater.cc:503] Master 127.1.206.126:34989 was elected leader, sending a full tablet report...
I20260810 14:34:32.203260 21713 ts_tablet_manager.cc:1428] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260810 14:34:32.203260 21714 ts_tablet_manager.cc:1428] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:34:32.203514 21715 ts_tablet_manager.cc:1428] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:34:32.203591 21543 heartbeater.cc:503] Master 127.1.206.126:34989 was elected leader, sending a full tablet report...
I20260810 14:34:32.204028 21693 heartbeater.cc:503] Master 127.1.206.126:34989 was elected leader, sending a full tablet report...
W20260810 14:34:32.220822 21396 tablet.cc:2369] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:34:32.383376 21694 tablet.cc:2369] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:34:32.431057 21544 tablet.cc:2369] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:34:32.431216 21720 raft_consensus.cc:482] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:32.431411 21720 raft_consensus.cc:504] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.432826 21720 leader_election.cc:288] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e690fec036984796826774fbcd569742 (127.1.206.67:39023), b398ba8b025448ccb9909677ca613947 (127.1.206.65:33433)
I20260810 14:34:32.437427 21722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.433153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:33433 (local address 127.1.206.66:43277)
0810 14:34:32.433550 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:32.433563 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:32.433695 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:32.434161 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:32.434164 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:32.434191 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:32.434306 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.434310 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.435081 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.435086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.436062 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.436073 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.436915 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.436919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.437036 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.437071 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 14:34:32.437154 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:34:32.437236 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":76,"thread_start_us":109,"threads_started":1}
I20260810 14:34:32.437419 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.433253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:43277 (local address 127.1.206.65:33433)
0810 14:34:32.433393 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.433398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.433661 (+ 263us) server_negotiation.cc:407] Connection header received
0810 14:34:32.433903 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.433907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.433960 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.434013 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:32.434447 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.434951 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.436208 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.436766 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.436899 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.436948 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.437195 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.437279 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 14:34:32.437876 21545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.433078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:39023 (local address 127.1.206.66:37321)
0810 14:34:32.433244 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:32.433262 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:32.433398 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:32.433874 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:32.433878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:32.433896 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:32.434016 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.434023 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.435142 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.435148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.436499 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:32.436512 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.437482 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.437487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:32.437577 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.437604 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 14:34:32.437687 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:34:32.437765 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":27}
I20260810 14:34:32.438344 21712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.433328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:37321 (local address 127.1.206.67:39023)
0810 14:34:32.433491 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.433498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.433515 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:34:32.433583 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.433586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.433659 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.433759 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:32.434168 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.434975 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.436653 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.437253 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.437372 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.437414 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.438157 (+ 743us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.438253 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 14:34:32.438490 21345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796b6f7fb3f54d44b08a3ac21da30159" candidate_uuid: "724cefc055c94ea083408f8baa24dc0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b398ba8b025448ccb9909677ca613947" is_pre_election: true
I20260810 14:34:32.438870 21345 raft_consensus.cc:2454] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 724cefc055c94ea083408f8baa24dc0c in term 0.
I20260810 14:34:32.438946 21644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796b6f7fb3f54d44b08a3ac21da30159" candidate_uuid: "724cefc055c94ea083408f8baa24dc0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e690fec036984796826774fbcd569742" is_pre_election: true
I20260810 14:34:32.439332 21644 raft_consensus.cc:2454] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 724cefc055c94ea083408f8baa24dc0c in term 0.
I20260810 14:34:32.439442 21417 leader_election.cc:302] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 724cefc055c94ea083408f8baa24dc0c, b398ba8b025448ccb9909677ca613947; no voters:
I20260810 14:34:32.439764 21720 raft_consensus.cc:2781] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:34:32.439872 21720 raft_consensus.cc:482] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:34:32.439929 21720 raft_consensus.cc:3037] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:32.441067 21720 raft_consensus.cc:504] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.441489 21720 leader_election.cc:288] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [CANDIDATE]: Term 1 election: Requested vote from peers e690fec036984796826774fbcd569742 (127.1.206.67:39023), b398ba8b025448ccb9909677ca613947 (127.1.206.65:33433)
I20260810 14:34:32.441893 21644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796b6f7fb3f54d44b08a3ac21da30159" candidate_uuid: "724cefc055c94ea083408f8baa24dc0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e690fec036984796826774fbcd569742"
I20260810 14:34:32.441967 21345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "796b6f7fb3f54d44b08a3ac21da30159" candidate_uuid: "724cefc055c94ea083408f8baa24dc0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b398ba8b025448ccb9909677ca613947"
I20260810 14:34:32.442037 21644 raft_consensus.cc:3037] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:32.442137 21345 raft_consensus.cc:3037] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:32.443264 21345 raft_consensus.cc:2454] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 724cefc055c94ea083408f8baa24dc0c in term 1.
I20260810 14:34:32.443446 21644 raft_consensus.cc:2454] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 724cefc055c94ea083408f8baa24dc0c in term 1.
I20260810 14:34:32.443674 21417 leader_election.cc:302] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 724cefc055c94ea083408f8baa24dc0c, b398ba8b025448ccb9909677ca613947; no voters:
I20260810 14:34:32.443897 21720 raft_consensus.cc:2781] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:32.444141 21720 raft_consensus.cc:686] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 1 LEADER]: Becoming Leader. State: Replica: 724cefc055c94ea083408f8baa24dc0c, State: Running, Role: LEADER
I20260810 14:34:32.444563 21720 consensus_queue.cc:237] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } }
I20260810 14:34:32.448621 21182 catalog_manager.cc:5495] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 724cefc055c94ea083408f8baa24dc0c (127.1.206.66). New cstate: current_term: 1 leader_uuid: "724cefc055c94ea083408f8baa24dc0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724cefc055c94ea083408f8baa24dc0c" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 41093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 } health_report { overall_health: UNKNOWN } } }
I20260810 14:34:32.473712 21708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.469417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46100 (local address 127.1.206.66:41093)
0810 14:34:32.469563 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:32.469567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:32.469581 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:34:32.469660 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:32.469662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:32.469721 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:32.469821 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:34:32.470150 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.471029 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.472194 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:32.472484 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:32.472583 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:32.472876 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:34:32.473356 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:34:32.473453 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:32.473515 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 14:34:32.473567 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:34:32.480283 21644 raft_consensus.cc:1261] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 1 FOLLOWER]: Refusing update from remote peer 724cefc055c94ea083408f8baa24dc0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:32.480249 21345 raft_consensus.cc:1261] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 1 FOLLOWER]: Refusing update from remote peer 724cefc055c94ea083408f8baa24dc0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:32.481196 21723 consensus_queue.cc:1035] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e690fec036984796826774fbcd569742" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 39023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:32.481480 21720 consensus_queue.cc:1035] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b398ba8b025448ccb9909677ca613947" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 33433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:32.489496 21726 mvcc.cc:205] Tried to move back new op lower bound from 7316981647270838272 to 7316981647136231424. Current Snapshot: MvccSnapshot[applied={T|T < 7316981647270838272}]
I20260810 14:34:32.490535 21728 mvcc.cc:205] Tried to move back new op lower bound from 7316981647270838272 to 7316981647136231424. Current Snapshot: MvccSnapshot[applied={T|T < 7316981647270838272}]
I20260810 14:34:32.493062 21727 mvcc.cc:205] Tried to move back new op lower bound from 7316981647270838272 to 7316981647136231424. Current Snapshot: MvccSnapshot[applied={T|T < 7316981647270838272}]
I20260810 14:34:32.499640 21182 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:32.499853 21182 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:32.502661 21182 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afdd6406a28b4dbfb596c3659f66ae21: Sending DeleteTablet for 3 replicas of tablet 796b6f7fb3f54d44b08a3ac21da30159
I20260810 14:34:32.503624 21620 tablet_service.cc:1514] Processing DeleteTablet for tablet 796b6f7fb3f54d44b08a3ac21da30159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:32 UTC) from {username='slave'} at 127.0.0.1:45736
I20260810 14:34:32.503625 21324 tablet_service.cc:1514] Processing DeleteTablet for tablet 796b6f7fb3f54d44b08a3ac21da30159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:32 UTC) from {username='slave'} at 127.0.0.1:42000
I20260810 14:34:32.503787 21467 tablet_service.cc:1514] Processing DeleteTablet for tablet 796b6f7fb3f54d44b08a3ac21da30159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:32 UTC) from {username='slave'} at 127.0.0.1:46084
I20260810 14:34:32.504446 21739 tablet_replica.cc:330] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: stopping tablet replica
I20260810 14:34:32.504566 21738 tablet_replica.cc:330] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947: stopping tablet replica
I20260810 14:34:32.504971 21738 raft_consensus.cc:2229] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:32.505074 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 21254
I20260810 14:34:32.505347 21738 raft_consensus.cc:2258] T 796b6f7fb3f54d44b08a3ac21da30159 P b398ba8b025448ccb9909677ca613947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:32.505729 21737 tablet_replica.cc:330] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: stopping tablet replica
I20260810 14:34:32.505992 21737 raft_consensus.cc:2229] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:32.506273 21737 raft_consensus.cc:2258] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:32.505034 21739 raft_consensus.cc:2229] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:34:32.506893 21739 raft_consensus.cc:2258] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:32.508451 21737 ts_tablet_manager.cc:1905] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:32.509089 21739 ts_tablet_manager.cc:1905] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:32.511600 21737 ts_tablet_manager.cc:1918] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:32.511731 21737 log.cc:1196] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/796b6f7fb3f54d44b08a3ac21da30159
I20260810 14:34:32.512075 21737 ts_tablet_manager.cc:1939] T 796b6f7fb3f54d44b08a3ac21da30159 P e690fec036984796826774fbcd569742: Deleting consensus metadata
I20260810 14:34:32.512872 21739 ts_tablet_manager.cc:1918] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:32.513094 21739 log.cc:1196] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/796b6f7fb3f54d44b08a3ac21da30159
I20260810 14:34:32.513530 21739 ts_tablet_manager.cc:1939] T 796b6f7fb3f54d44b08a3ac21da30159 P 724cefc055c94ea083408f8baa24dc0c: Deleting consensus metadata
I20260810 14:34:32.513576 21170 catalog_manager.cc:4841] TS e690fec036984796826774fbcd569742 (127.1.206.67:39023): tablet 796b6f7fb3f54d44b08a3ac21da30159 (table test-table [id=3785e029d58e4046b0ab1c3afda5b309]) successfully deleted
I20260810 14:34:32.514987 21171 catalog_manager.cc:4841] TS 724cefc055c94ea083408f8baa24dc0c (127.1.206.66:41093): tablet 796b6f7fb3f54d44b08a3ac21da30159 (table test-table [id=3785e029d58e4046b0ab1c3afda5b309]) successfully deleted
W20260810 14:34:32.518993 21169 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:33433 (error 108)
I20260810 14:34:32.519140 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 21399
I20260810 14:34:32.521996 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:32.521166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:33433 (local address 127.0.0.1:42010)
0810 14:34:32.521758 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:32.521868 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:33433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455}
W20260810 14:34:32.522225 21169 catalog_manager.cc:4584] TS b398ba8b025448ccb9909677ca613947 (127.1.206.65:33433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 796b6f7fb3f54d44b08a3ac21da30159: Network error: Client connection negotiation failed: client connection to 127.1.206.65:33433: connect: Connection refused (error 111)
I20260810 14:34:32.527225 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 21546
I20260810 14:34:32.535300 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 21154
2026-08-10T14:34:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1330 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:32 dist-test-slave-0b58 krb5kdc[21749](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:32 dist-test-slave-0b58 krb5kdc[21749](info): set up 2 sockets
Aug 10 14:34:32 dist-test-slave-0b58 krb5kdc[21749](info): commencing operation
krb5kdc: starting...
W20260810 14:34:33.741780 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:33 dist-test-slave-0b58 krb5kdc[21749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:34:33.925150 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:41015
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:41015
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:34.122820 21763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:34.123356 21763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:34.123522 21763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:34.130198 21763 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:34.130405 21763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:34.130514 21763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:34.130614 21763 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:34.130707 21763 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:34.139467 21763 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:41015
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:41015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:34.141659 21763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:34.143564 21763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:34.157315 21774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:34.157315 21770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:34.157401 21769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:34.157994 21763 server_base.cc:1034] running on GCE node
I20260810 14:34:34.158939 21763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:34.160861 21763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:34.162130 21763 hybrid_clock.cc:648] HybridClock initialized: now 1786372474162099 us; error 68 us; skew 500 ppm
Aug 10 14:34:34 dist-test-slave-0b58 krb5kdc[21749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372474, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:34.169912 21763 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:34:34.171474 21763 webserver.cc:460] Webserver started at http://127.1.206.126:42791/ using document root <none> and password file <none>
I20260810 14:34:34.172422 21763 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:34.172533 21763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:34.172866 21763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:34.176318 21763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "27920b2bb1f642e0841fb69e8888e1ab"
format_stamp: "Formatted at 2026-08-10 14:34:34 on dist-test-slave-0b58"
server_key: "37a47cbd359db5ce278350a792f5fcca"
server_key_iv: "8740352aebdf2f2693321e6240426bb5"
server_key_version: "encryptionkey@0"
I20260810 14:34:34.177280 21763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "27920b2bb1f642e0841fb69e8888e1ab"
format_stamp: "Formatted at 2026-08-10 14:34:34 on dist-test-slave-0b58"
server_key: "37a47cbd359db5ce278350a792f5fcca"
server_key_iv: "8740352aebdf2f2693321e6240426bb5"
server_key_version: "encryptionkey@0"
I20260810 14:34:34.183794 21763 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260810 14:34:34.187997 21781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:34.190116 21763 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:34:34.190366 21763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "27920b2bb1f642e0841fb69e8888e1ab"
format_stamp: "Formatted at 2026-08-10 14:34:34 on dist-test-slave-0b58"
server_key: "37a47cbd359db5ce278350a792f5fcca"
server_key_iv: "8740352aebdf2f2693321e6240426bb5"
server_key_version: "encryptionkey@0"
I20260810 14:34:34.190562 21763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:34.219708 21763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:34.228404 21763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:34.228891 21763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:34.246163 21763 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:41015
I20260810 14:34:34.246174 21841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:41015 every 8 connection(s)
I20260810 14:34:34.247922 21763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:34.249253 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 21763
I20260810 14:34:34.249487 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:34.250015 1849 external_mini_cluster.cc:1428] Setting key 1d8e56971fb79fe40da97a8db8dfd6e0
I20260810 14:34:34.253222 21842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:34.264602 21842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab: Bootstrap starting.
Aug 10 14:34:34 dist-test-slave-0b58 krb5kdc[21749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:34.268057 21842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:34.269225 21842 log.cc:824] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:34.272224 21842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab: No bootstrap required, opened a new log
I20260810 14:34:34.273912 21846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:34.252575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40390 (local address 127.1.206.126:41015)
0810 14:34:34.253226 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:34.253271 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:34.253330 (+ 59us) server_negotiation.cc:407] Connection header received
0810 14:34:34.254416 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:34.254434 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:34.254912 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:34.255310 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:34.257053 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:34.258581 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:34.260606 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:34.261347 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:34.261539 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:34.266278 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:34.266291 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:34.266305 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:34.266343 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:34.269079 (+ 2736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:34.269903 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:34.269909 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:34.269913 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:34.270083 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:34.270607 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:34.270618 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:34.270623 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:34.271250 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:34.271631 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:34.272162 (+ 531us) server_negotiation.cc:299] Negotiation successful
0810 14:34:34.272704 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":238,"threads_started":1}
I20260810 14:34:34.279279 21842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27920b2bb1f642e0841fb69e8888e1ab" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41015 } }
I20260810 14:34:34.279748 21842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:34.279881 21842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27920b2bb1f642e0841fb69e8888e1ab, State: Initialized, Role: FOLLOWER
I20260810 14:34:34.280673 21842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27920b2bb1f642e0841fb69e8888e1ab" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41015 } }
I20260810 14:34:34.280902 21842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:34.281049 21842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:34.281257 21842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:34.283545 21842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27920b2bb1f642e0841fb69e8888e1ab" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41015 } }
I20260810 14:34:34.284006 21842 leader_election.cc:302] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27920b2bb1f642e0841fb69e8888e1ab; no voters:
I20260810 14:34:34.284520 21842 leader_election.cc:288] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:34.284737 21849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:34.285204 21849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [term 1 LEADER]: Becoming Leader. State: Replica: 27920b2bb1f642e0841fb69e8888e1ab, State: Running, Role: LEADER
I20260810 14:34:34.285737 21849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27920b2bb1f642e0841fb69e8888e1ab" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41015 } }
I20260810 14:34:34.286785 21842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:34.288787 21850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27920b2bb1f642e0841fb69e8888e1ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27920b2bb1f642e0841fb69e8888e1ab" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41015 } } }
I20260810 14:34:34.288847 21851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27920b2bb1f642e0841fb69e8888e1ab. Latest consensus state: current_term: 1 leader_uuid: "27920b2bb1f642e0841fb69e8888e1ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27920b2bb1f642e0841fb69e8888e1ab" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 41015 } } }
I20260810 14:34:34.289101 21850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:34.289100 21851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab [sys.catalog]: This master's current role is: LEADER
W20260810 14:34:34.295511 21868 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:34:34.295660 21868 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:34:34.295749 21860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:34.297453 21860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:34.307391 21860 catalog_manager.cc:1347] Generated new cluster ID: 986ef8dfb9834b21bb83f6b146d850ba
I20260810 14:34:34.307505 21860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:34.319964 21860 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:34.321480 21860 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:34.328614 21860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab: Generated new TSK 0
I20260810 14:34:34.329789 21860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:34:34.376145 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41015
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:34.589145 21874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:34.589747 21874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:34.589917 21874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:34.597251 21874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:34.597360 21874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:34.597543 21874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:34:34.607283 21874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:34.609483 21874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:34.611418 21874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:34.627981 21883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:34.627981 21885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:34.628652 21874 server_base.cc:1034] running on GCE node
W20260810 14:34:34.628700 21881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:34.629508 21874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:34.630676 21874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:34.631923 21874 hybrid_clock.cc:648] HybridClock initialized: now 1786372474631899 us; error 45 us; skew 500 ppm
Aug 10 14:34:34 dist-test-slave-0b58 krb5kdc[21749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372474, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:34.636742 21874 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:34:34.638147 21874 webserver.cc:460] Webserver started at http://127.1.206.65:40963/ using document root <none> and password file <none>
I20260810 14:34:34.639139 21874 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:34.639302 21874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:34.639681 21874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:34.643378 21874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "5e7c93b5112541d48d5acfde33b865c5"
format_stamp: "Formatted at 2026-08-10 14:34:34 on dist-test-slave-0b58"
server_key: "748155cedce74e5039b443442703a4bf"
server_key_iv: "19a8afba726c1b335d06629b17a08ee4"
server_key_version: "encryptionkey@0"
I20260810 14:34:34.644511 21874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "5e7c93b5112541d48d5acfde33b865c5"
format_stamp: "Formatted at 2026-08-10 14:34:34 on dist-test-slave-0b58"
server_key: "748155cedce74e5039b443442703a4bf"
server_key_iv: "19a8afba726c1b335d06629b17a08ee4"
server_key_version: "encryptionkey@0"
I20260810 14:34:34.651310 21874 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260810 14:34:34.655813 21893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:34.658136 21874 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:34:34.658383 21874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "5e7c93b5112541d48d5acfde33b865c5"
format_stamp: "Formatted at 2026-08-10 14:34:34 on dist-test-slave-0b58"
server_key: "748155cedce74e5039b443442703a4bf"
server_key_iv: "19a8afba726c1b335d06629b17a08ee4"
server_key_version: "encryptionkey@0"
I20260810 14:34:34.658605 21874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:34.687755 21874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:34.693150 21874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:34.693490 21874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:34.694502 21874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:34.695818 21874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:34.695922 21874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:34.696091 21874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:34.696200 21874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:34.712672 21874 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:32893
I20260810 14:34:34.712706 22022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:32893 every 8 connection(s)
I20260810 14:34:34.714331 21874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:34:34.720317 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 21874
I20260810 14:34:34.720608 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:34:34.721118 1849 external_mini_cluster.cc:1428] Setting key 5eab7fe4f6cd647a139e696e0d298e95
Aug 10 14:34:34 dist-test-slave-0b58 krb5kdc[21749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372474, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:34:34.742276 21846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:34.717619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:39445 (local address 127.1.206.126:41015)
0810 14:34:34.717852 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:34.717857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:34.719578 (+ 1721us) server_negotiation.cc:407] Connection header received
0810 14:34:34.722162 (+ 2584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:34.722167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:34.722261 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:34.722451 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:34.725338 (+ 2887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:34.726812 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:34.728980 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:34.729355 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:34.729590 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:34.734615 (+ 5025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:34.734622 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:34.734638 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:34.734713 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:34.738162 (+ 3449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:34.739153 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:34.739171 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:34.739176 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:34.739359 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:34.740020 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:34.740026 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:34.740029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:34.740486 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:34.740652 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:34.741739 (+ 1087us) server_negotiation.cc:299] Negotiation successful
0810 14:34:34.741983 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:34:34.743861 22025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:34.718346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41015 (local address 127.1.206.65:39445)
0810 14:34:34.719249 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:34.719350 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:34.721603 (+ 2253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:34.722874 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:34.722887 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:34.724024 (+ 1137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:34.725016 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:34.725056 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:34.727021 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:34.727024 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:34.728749 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:34.728769 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:34.729699 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:34.729705 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:34.730014 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:34.731157 (+ 1143us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:34.731194 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:34.734249 (+ 3055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:34.738406 (+ 4157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:34.738413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:34.738438 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:34.738943 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:34.739516 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:34.739518 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:34.739520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:34.739817 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:34.740650 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:34.740657 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:34.741299 (+ 642us) client_negotiation.cc:769] Sending connection context
0810 14:34:34.741574 (+ 275us) client_negotiation.cc:240] Negotiation successful
0810 14:34:34.742208 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":187,"threads_started":1}
I20260810 14:34:34.746016 22023 heartbeater.cc:347] Connected to a master server at 127.1.206.126:41015
I20260810 14:34:34.746444 22023 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:34.747295 22023 heartbeater.cc:511] Master 127.1.206.126:41015 requested a full tablet report, sending...
I20260810 14:34:34.749864 21801 ts_manager.cc:194] Registered new tserver with Master: 5e7c93b5112541d48d5acfde33b865c5 (127.1.206.65:32893)
I20260810 14:34:34.751634 21801 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:39445
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:34:34.767649 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41015
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:34.995168 22028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:34.995692 22028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:34.995853 22028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:35.002776 22028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:35.002880 22028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:35.003078 22028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:34:35.012423 22028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:35.014389 22028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:35.016224 22028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:35.032408 22034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:35.032469 22038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:35.032413 22033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:35.032773 22028 server_base.cc:1034] running on GCE node
I20260810 14:34:35.033577 22028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:35.034590 22028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:35.035825 22028 hybrid_clock.cc:648] HybridClock initialized: now 1786372475035790 us; error 38 us; skew 500 ppm
Aug 10 14:34:35 dist-test-slave-0b58 krb5kdc[21749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372475, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:35.040477 22028 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:34:35.041914 22028 webserver.cc:460] Webserver started at http://127.1.206.66:44979/ using document root <none> and password file <none>
I20260810 14:34:35.042816 22028 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:35.042927 22028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:35.043196 22028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:35.046386 22028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "216e21a9471b4702804b74fce2514a15"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "87866bbdaba85bff41168e6eaed76a8d"
server_key_iv: "ea8d228b46ebbe6c877d76ab24b3f780"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.047142 22028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "216e21a9471b4702804b74fce2514a15"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "87866bbdaba85bff41168e6eaed76a8d"
server_key_iv: "ea8d228b46ebbe6c877d76ab24b3f780"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.052595 22028 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260810 14:34:35.055815 22046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:35.057545 22028 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:35.057708 22028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "216e21a9471b4702804b74fce2514a15"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "87866bbdaba85bff41168e6eaed76a8d"
server_key_iv: "ea8d228b46ebbe6c877d76ab24b3f780"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.057864 22028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:35.095058 22028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:35.101189 22028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:35.101598 22028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:35.102689 22028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:35.104125 22028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:35.104233 22028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:35.104494 22028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:35.104583 22028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:35.123479 22028 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:36165
I20260810 14:34:35.123529 22170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:36165 every 8 connection(s)
I20260810 14:34:35.125295 22028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:34:35.133724 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 22028
I20260810 14:34:35.134025 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:34:35.134668 1849 external_mini_cluster.cc:1428] Setting key adac4197818271d56b3ca44484fd40a7
Aug 10 14:34:35 dist-test-slave-0b58 krb5kdc[21749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372475, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:35.152899 21846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.128640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:59001 (local address 127.1.206.126:41015)
0810 14:34:35.128871 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.128876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.130823 (+ 1947us) server_negotiation.cc:407] Connection header received
0810 14:34:35.133886 (+ 3063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.133928 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.134049 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.134248 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:35.137049 (+ 2801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.137866 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.140102 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.140556 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.140791 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.145446 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:35.145451 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:35.145453 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:35.145497 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:35.148909 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:35.149810 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:35.149823 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:35.149825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:35.149953 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:35.150617 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:35.150622 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:35.150624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:35.150953 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:35.151229 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.152243 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.152484 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260810 14:34:35.154425 22173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.129519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41015 (local address 127.1.206.66:59001)
0810 14:34:35.130475 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.130593 (+ 118us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:35.133346 (+ 2753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:35.134780 (+ 1434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:35.134811 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:35.135753 (+ 942us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:35.136787 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.136826 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.138187 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.138191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.139840 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.139862 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.140874 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.140884 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.141252 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.142471 (+ 1219us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:35.142501 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:35.145059 (+ 2558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:35.149162 (+ 4103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:35.149173 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:35.149197 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:35.149641 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:35.150147 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:35.150152 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:35.150157 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:35.150415 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:35.151219 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:35.151246 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:35.151708 (+ 462us) client_negotiation.cc:769] Sending connection context
0810 14:34:35.152089 (+ 381us) client_negotiation.cc:240] Negotiation successful
0810 14:34:35.152831 (+ 742us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":206,"threads_started":1}
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:34:35.156767 22171 heartbeater.cc:347] Connected to a master server at 127.1.206.126:41015
I20260810 14:34:35.157048 22171 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
I20260810 14:34:35.158021 22171 heartbeater.cc:511] Master 127.1.206.126:41015 requested a full tablet report, sending...
I20260810 14:34:35.159970 21801 ts_manager.cc:194] Registered new tserver with Master: 216e21a9471b4702804b74fce2514a15 (127.1.206.66:36165)
I20260810 14:34:35.161743 21801 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:59001
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:34:35.184203 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41015
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:41705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:35.378418 22176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:35.378957 22176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:35.379119 22176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:35.385406 22176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:35.385551 22176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:35.385706 22176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:34:35.394351 22176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:41705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:41015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:35.396202 22176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:35.397962 22176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:35.413867 22181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:35.413890 22185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:35.413901 22182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:35.414307 22176 server_base.cc:1034] running on GCE node
I20260810 14:34:35.415103 22176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:35.416201 22176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:35.417470 22176 hybrid_clock.cc:648] HybridClock initialized: now 1786372475417439 us; error 51 us; skew 500 ppm
Aug 10 14:34:35 dist-test-slave-0b58 krb5kdc[21749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372475, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:35.422080 22176 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:34:35.423617 22176 webserver.cc:460] Webserver started at http://127.1.206.67:39977/ using document root <none> and password file <none>
I20260810 14:34:35.424642 22176 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:35.424746 22176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:35.425172 22176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:35.428717 22176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "5827ed0808474cc7a78e2837ebb78726"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "8a9237e74dbb454e76d938de848629f9"
server_key_iv: "28d36f322f540dfec31c3330a4d0bdef"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.429700 22176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "5827ed0808474cc7a78e2837ebb78726"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "8a9237e74dbb454e76d938de848629f9"
server_key_iv: "28d36f322f540dfec31c3330a4d0bdef"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.436537 22176 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260810 14:34:35.440815 22194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:35.442904 22176 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:34:35.443148 22176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "5827ed0808474cc7a78e2837ebb78726"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "8a9237e74dbb454e76d938de848629f9"
server_key_iv: "28d36f322f540dfec31c3330a4d0bdef"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.443362 22176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:35.467424 22176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:35.471943 22176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:35.472394 22176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:35.473376 22176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:35.474696 22176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:35.474819 22176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:35.474985 22176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:35.475052 22176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:35.491402 22176 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:37605
I20260810 14:34:35.491449 22325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:37605 every 8 connection(s)
I20260810 14:34:35.492913 22176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:34:35.497340 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 22176
I20260810 14:34:35.497571 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:34:35.498205 1849 external_mini_cluster.cc:1428] Setting key a0b81dcd67916f645cf312f4aeac03d3
Aug 10 14:34:35 dist-test-slave-0b58 krb5kdc[21749](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372475, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:35.517581 21846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.495950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:49129 (local address 127.1.206.126:41015)
0810 14:34:35.496156 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.496160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.497915 (+ 1755us) server_negotiation.cc:407] Connection header received
0810 14:34:35.500503 (+ 2588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.500507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.500590 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.500768 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:35.503073 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.503927 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.506011 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.506412 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.506654 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.510809 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:35.510820 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:35.510822 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:35.510871 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:35.513435 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:35.514435 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:35.514439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:35.514440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:35.514592 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:35.515322 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:35.515335 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:35.515338 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:35.515691 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:35.515910 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.516922 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.517187 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 14:34:35.519161 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.496631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:41015 (local address 127.1.206.67:49129)
0810 14:34:35.497596 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.497707 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:35.499991 (+ 2284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:35.501083 (+ 1092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:35.501099 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:35.501885 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:35.502824 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.502840 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.504130 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.504157 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.505731 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.505748 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.506718 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.506724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.507051 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.507960 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:35.507995 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:35.510493 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:35.513699 (+ 3206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:35.513717 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:35.513748 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:35.514220 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:35.514806 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:35.514821 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:35.514823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:35.515066 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:35.515891 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:35.515907 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:35.516483 (+ 576us) client_negotiation.cc:769] Sending connection context
0810 14:34:35.516784 (+ 301us) client_negotiation.cc:240] Negotiation successful
0810 14:34:35.517563 (+ 779us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":241,"threads_started":1}
I20260810 14:34:35.521275 22326 heartbeater.cc:347] Connected to a master server at 127.1.206.126:41015
I20260810 14:34:35.521731 22326 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:35.522689 22326 heartbeater.cc:511] Master 127.1.206.126:41015 requested a full tablet report, sending...
I20260810 14:34:35.524894 21801 ts_manager.cc:194] Registered new tserver with Master: 5827ed0808474cc7a78e2837ebb78726 (127.1.206.67:37605)
I20260810 14:34:35.526315 21801 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:49129
I20260810 14:34:35.527869 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:34:35.545672 21846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.531475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40398 (local address 127.1.206.126:41015)
0810 14:34:35.531667 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.531671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.532144 (+ 473us) server_negotiation.cc:407] Connection header received
0810 14:34:35.532479 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.532483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.532562 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.532743 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:35.534058 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.534864 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.536302 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.536650 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.536883 (+ 233us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.539602 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:35.539608 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:35.539626 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:35.539667 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:35.541983 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:35.543015 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:35.543019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:35.543021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:35.543167 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:35.543997 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:35.544000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:35.544001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:35.544416 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:35.544678 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.545053 (+ 375us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.545265 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260810 14:34:35.551214 21801 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:34:35.556069 21801 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:34:35.571185 22348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.566046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43160 (local address 127.1.206.66:36165)
0810 14:34:35.566681 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.566711 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.566735 (+ 24us) server_negotiation.cc:407] Connection header received
0810 14:34:35.566815 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.566819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.567010 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.567181 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:35.567368 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.568099 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.569931 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.570506 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.570634 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.570802 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.570931 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.571025 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":116,"threads_started":1}
I20260810 14:34:35.571369 22343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.564955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:32893 (local address 127.0.0.1:55166)
0810 14:34:35.565387 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.565451 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:35.565586 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:35.566709 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:35.566729 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:35.566754 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:35.566930 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.566938 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.568570 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.568574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.569857 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.569868 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.570867 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.570871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.570971 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.570992 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 14:34:35.571044 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:34:35.571133 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"mutex_wait_us":135,"thread_start_us":146,"threads_started":1}
I20260810 14:34:35.571174 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.565811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:36165 (local address 127.0.0.1:43160)
0810 14:34:35.566113 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.566128 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:35.566216 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:35.567157 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:35.567160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:35.567179 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:35.567269 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.567275 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.568234 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.568240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.569782 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.569794 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.570634 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.570638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.570754 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.570792 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 14:34:35.570902 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 14:34:35.571025 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":42,"thread_start_us":91,"threads_started":1}
I20260810 14:34:35.571584 22345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.565477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:37605 (local address 127.0.0.1:40716)
0810 14:34:35.565713 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.565746 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:35.565828 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:35.566854 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:35.566857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:35.566871 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:35.566942 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.566947 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.568639 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.568643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.569755 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.569766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.570866 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.570871 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.571289 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.571309 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 14:34:35.571385 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:34:35.571461 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":366,"thread_start_us":88,"threads_started":1}
I20260810 14:34:35.571951 22346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.565725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40716 (local address 127.1.206.67:37605)
0810 14:34:35.566444 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.566454 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.566474 (+ 20us) server_negotiation.cc:407] Connection header received
0810 14:34:35.566541 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.566546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.566708 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.567091 (+ 383us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:35.567242 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.568454 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.569894 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.570715 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.570918 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.571063 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.571763 (+ 700us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.571843 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":136,"threads_started":1}
I20260810 14:34:35.572587 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.565068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.1.206.65:32893)
0810 14:34:35.566191 (+ 1123us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.566199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.566225 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:34:35.566311 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.566317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.566537 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.567091 (+ 554us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:35.567233 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.568447 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.569954 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.570724 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.572156 (+ 1432us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.572318 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.572366 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.572454 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":986,"thread_start_us":110,"threads_started":1}
I20260810 14:34:35.574788 22247 tablet_service.cc:1467] Processing CreateTablet for tablet 6284694abb44430b8c9830cbe5597d43 (DEFAULT_TABLE table=test-table [id=70593066803a43fea32744de98bd0a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:35.574788 22099 tablet_service.cc:1467] Processing CreateTablet for tablet 6284694abb44430b8c9830cbe5597d43 (DEFAULT_TABLE table=test-table [id=70593066803a43fea32744de98bd0a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:35.575934 22247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6284694abb44430b8c9830cbe5597d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:35.575932 22099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6284694abb44430b8c9830cbe5597d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:35.578778 21951 tablet_service.cc:1467] Processing CreateTablet for tablet 6284694abb44430b8c9830cbe5597d43 (DEFAULT_TABLE table=test-table [id=70593066803a43fea32744de98bd0a0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:35.579692 21951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6284694abb44430b8c9830cbe5597d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:35.583503 22350 tablet_bootstrap.cc:492] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Bootstrap starting.
I20260810 14:34:35.583961 22349 tablet_bootstrap.cc:492] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Bootstrap starting.
I20260810 14:34:35.586109 22350 tablet_bootstrap.cc:654] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:35.586252 22349 tablet_bootstrap.cc:654] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:35.587522 22349 log.cc:824] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:35.587523 22350 log.cc:824] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:35.587700 22351 tablet_bootstrap.cc:492] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5: Bootstrap starting.
I20260810 14:34:35.589669 22351 tablet_bootstrap.cc:654] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:35.589689 22350 tablet_bootstrap.cc:492] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: No bootstrap required, opened a new log
I20260810 14:34:35.589691 22349 tablet_bootstrap.cc:492] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: No bootstrap required, opened a new log
I20260810 14:34:35.589875 22349 ts_tablet_manager.cc:1397] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:34:35.589875 22350 ts_tablet_manager.cc:1397] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 14:34:35.590476 22351 log.cc:824] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:35.592134 22351 tablet_bootstrap.cc:492] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5: No bootstrap required, opened a new log
I20260810 14:34:35.592397 22351 ts_tablet_manager.cc:1397] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260810 14:34:35.593883 22350 raft_consensus.cc:348] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.594161 22350 raft_consensus.cc:374] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:35.594229 22350 raft_consensus.cc:729] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216e21a9471b4702804b74fce2514a15, State: Initialized, Role: FOLLOWER
I20260810 14:34:35.594534 22349 raft_consensus.cc:348] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.594681 22350 consensus_queue.cc:260] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.594957 22349 raft_consensus.cc:374] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:35.595055 22349 raft_consensus.cc:729] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5827ed0808474cc7a78e2837ebb78726, State: Initialized, Role: FOLLOWER
I20260810 14:34:35.595350 22171 heartbeater.cc:503] Master 127.1.206.126:41015 was elected leader, sending a full tablet report...
I20260810 14:34:35.595588 22349 consensus_queue.cc:260] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.595712 22350 ts_tablet_manager.cc:1428] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:34:35.596340 22326 heartbeater.cc:503] Master 127.1.206.126:41015 was elected leader, sending a full tablet report...
I20260810 14:34:35.596634 22349 ts_tablet_manager.cc:1428] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 14:34:35.597146 22351 raft_consensus.cc:348] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.597409 22351 raft_consensus.cc:374] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:35.597470 22351 raft_consensus.cc:729] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7c93b5112541d48d5acfde33b865c5, State: Initialized, Role: FOLLOWER
I20260810 14:34:35.597882 22351 consensus_queue.cc:260] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.598860 22351 ts_tablet_manager.cc:1428] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:34:35.598878 22023 heartbeater.cc:503] Master 127.1.206.126:41015 was elected leader, sending a full tablet report...
I20260810 14:34:35.614024 22356 raft_consensus.cc:482] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:35.614231 22356 raft_consensus.cc:504] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.615391 22356 leader_election.cc:288] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7c93b5112541d48d5acfde33b865c5 (127.1.206.65:32893), 5827ed0808474cc7a78e2837ebb78726 (127.1.206.67:37605)
I20260810 14:34:35.618952 22173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.615601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:32893 (local address 127.1.206.66:53413)
0810 14:34:35.615727 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.615744 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:35.615861 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:35.616091 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:35.616094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:35.616114 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:35.616245 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.616251 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.617049 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.617056 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.617844 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.617854 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.618511 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.618515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.618622 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.618649 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 14:34:35.618740 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 14:34:35.618816 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 14:34:35.618952 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.615711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:53413 (local address 127.1.206.65:32893)
0810 14:34:35.615862 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.615874 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.615889 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:34:35.615942 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.615944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.615981 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.616076 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:35.616422 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.616937 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.617975 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.618388 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.618519 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.618571 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.618760 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.618835 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:34:35.619637 22359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.615618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:37605 (local address 127.1.206.66:50939)
0810 14:34:35.616316 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.616335 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:35.616448 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:35.616713 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:35.616715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:35.616731 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:35.616860 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.616865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.617587 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.617592 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.618390 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:35.618399 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.619263 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.619267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:35.619381 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.619413 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 14:34:35.619476 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 14:34:35.619528 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":318,"thread_start_us":149,"threads_started":1}
I20260810 14:34:35.619706 22346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.615794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:50939 (local address 127.1.206.67:37605)
0810 14:34:35.615950 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.615954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.616419 (+ 465us) server_negotiation.cc:407] Connection header received
0810 14:34:35.616562 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.616565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.616613 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.616692 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:35.616972 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.617472 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.618522 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.618938 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.619087 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.619155 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.619523 (+ 368us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.619597 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 14:34:35.619704 21974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6284694abb44430b8c9830cbe5597d43" candidate_uuid: "216e21a9471b4702804b74fce2514a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7c93b5112541d48d5acfde33b865c5" is_pre_election: true
I20260810 14:34:35.620039 21974 raft_consensus.cc:2454] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216e21a9471b4702804b74fce2514a15 in term 0.
I20260810 14:34:35.620360 22272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6284694abb44430b8c9830cbe5597d43" candidate_uuid: "216e21a9471b4702804b74fce2514a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5827ed0808474cc7a78e2837ebb78726" is_pre_election: true
I20260810 14:34:35.620645 22047 leader_election.cc:302] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 216e21a9471b4702804b74fce2514a15, 5e7c93b5112541d48d5acfde33b865c5; no voters:
I20260810 14:34:35.620659 22272 raft_consensus.cc:2454] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 216e21a9471b4702804b74fce2514a15 in term 0.
I20260810 14:34:35.620921 22356 raft_consensus.cc:2781] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:34:35.621026 22356 raft_consensus.cc:482] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:34:35.621075 22356 raft_consensus.cc:3037] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:35.622236 22356 raft_consensus.cc:504] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
I20260810 14:34:35.622568 22356 leader_election.cc:288] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7c93b5112541d48d5acfde33b865c5 (127.1.206.65:32893), 5827ed0808474cc7a78e2837ebb78726 (127.1.206.67:37605)
I20260810 14:34:35.622927 21974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6284694abb44430b8c9830cbe5597d43" candidate_uuid: "216e21a9471b4702804b74fce2514a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7c93b5112541d48d5acfde33b865c5"
I20260810 14:34:35.622939 22272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6284694abb44430b8c9830cbe5597d43" candidate_uuid: "216e21a9471b4702804b74fce2514a15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5827ed0808474cc7a78e2837ebb78726"
I20260810 14:34:35.623063 21974 raft_consensus.cc:3037] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:35.623096 22272 raft_consensus.cc:3037] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:35.624298 21974 raft_consensus.cc:2454] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216e21a9471b4702804b74fce2514a15 in term 1.
I20260810 14:34:35.624320 22272 raft_consensus.cc:2454] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 216e21a9471b4702804b74fce2514a15 in term 1.
I20260810 14:34:35.624655 22050 leader_election.cc:302] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 216e21a9471b4702804b74fce2514a15, 5827ed0808474cc7a78e2837ebb78726, 5e7c93b5112541d48d5acfde33b865c5; no voters:
I20260810 14:34:35.624866 22356 raft_consensus.cc:2781] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:35.625092 22356 raft_consensus.cc:686] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 1 LEADER]: Becoming Leader. State: Replica: 216e21a9471b4702804b74fce2514a15, State: Running, Role: LEADER
I20260810 14:34:35.625427 22356 consensus_queue.cc:237] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } }
W20260810 14:34:35.626865 22172 tablet.cc:2369] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:34:35.628981 21799 catalog_manager.cc:5495] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 216e21a9471b4702804b74fce2514a15 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "216e21a9471b4702804b74fce2514a15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "216e21a9471b4702804b74fce2514a15" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 36165 } health_report { overall_health: HEALTHY } } }
I20260810 14:34:35.651260 22348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.647235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43172 (local address 127.1.206.66:36165)
0810 14:34:35.647379 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.647384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.647399 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:34:35.647531 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.647534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.647588 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.647708 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:34:35.647983 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.648568 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.649462 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.649765 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.649881 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.650236 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:34:35.650726 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:34:35.650923 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.651038 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.651097 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:34:35.657290 21974 raft_consensus.cc:1261] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5 [term 1 FOLLOWER]: Refusing update from remote peer 216e21a9471b4702804b74fce2514a15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:35.657291 22272 raft_consensus.cc:1261] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 1 FOLLOWER]: Refusing update from remote peer 216e21a9471b4702804b74fce2514a15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:35.658223 22360 consensus_queue.cc:1035] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7c93b5112541d48d5acfde33b865c5" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 32893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:35.658427 22356 consensus_queue.cc:1035] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5827ed0808474cc7a78e2837ebb78726" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:35.668080 22366 mvcc.cc:205] Tried to move back new op lower bound from 7316981660284162048 to 7316981660165079040. Current Snapshot: MvccSnapshot[applied={T|T < 7316981660284162048}]
I20260810 14:34:35.676788 21800 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:35.676988 21800 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:35.679665 21800 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 27920b2bb1f642e0841fb69e8888e1ab: Sending DeleteTablet for 3 replicas of tablet 6284694abb44430b8c9830cbe5597d43
I20260810 14:34:35.680575 21951 tablet_service.cc:1514] Processing DeleteTablet for tablet 6284694abb44430b8c9830cbe5597d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:35 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:55166
I20260810 14:34:35.680598 22247 tablet_service.cc:1514] Processing DeleteTablet for tablet 6284694abb44430b8c9830cbe5597d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:35 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:40716
I20260810 14:34:35.681269 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 21874
I20260810 14:34:35.681360 22376 tablet_replica.cc:330] T 6284694abb44430b8c9830cbe5597d43 P 5e7c93b5112541d48d5acfde33b865c5: stopping tablet replica
I20260810 14:34:35.681502 22099 tablet_service.cc:1514] Processing DeleteTablet for tablet 6284694abb44430b8c9830cbe5597d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:35 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:43160
I20260810 14:34:35.683885 22378 tablet_replica.cc:330] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: stopping tablet replica
I20260810 14:34:35.684181 22378 raft_consensus.cc:2229] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:34:35.684355 22377 tablet_replica.cc:330] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: stopping tablet replica
I20260810 14:34:35.684690 22378 raft_consensus.cc:2258] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:35.684715 22377 raft_consensus.cc:2229] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:35.685130 22377 raft_consensus.cc:2258] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:35.686182 22378 ts_tablet_manager.cc:1905] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:35.686736 22377 ts_tablet_manager.cc:1905] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:35.689306 22378 ts_tablet_manager.cc:1918] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:35.689400 22378 log.cc:1196] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/6284694abb44430b8c9830cbe5597d43
I20260810 14:34:35.689725 22378 ts_tablet_manager.cc:1939] T 6284694abb44430b8c9830cbe5597d43 P 216e21a9471b4702804b74fce2514a15: Deleting consensus metadata
I20260810 14:34:35.690001 22377 ts_tablet_manager.cc:1918] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:35.690099 22377 log.cc:1196] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/6284694abb44430b8c9830cbe5597d43
I20260810 14:34:35.690433 22377 ts_tablet_manager.cc:1939] T 6284694abb44430b8c9830cbe5597d43 P 5827ed0808474cc7a78e2837ebb78726: Deleting consensus metadata
I20260810 14:34:35.690909 21787 catalog_manager.cc:4841] TS 216e21a9471b4702804b74fce2514a15 (127.1.206.66:36165): tablet 6284694abb44430b8c9830cbe5597d43 (table test-table [id=70593066803a43fea32744de98bd0a0f]) successfully deleted
I20260810 14:34:35.691633 21787 catalog_manager.cc:4841] TS 5827ed0808474cc7a78e2837ebb78726 (127.1.206.67:37605): tablet 6284694abb44430b8c9830cbe5597d43 (table test-table [id=70593066803a43fea32744de98bd0a0f]) successfully deleted
W20260810 14:34:35.694038 21783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:32893 (error 108)
I20260810 14:34:35.694950 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 22028
I20260810 14:34:35.695165 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.694818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:32893 (local address 127.0.0.1:55182)
0810 14:34:35.694979 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:35.695063 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:32893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260810 14:34:35.698529 21783 catalog_manager.cc:4584] TS 5e7c93b5112541d48d5acfde33b865c5 (127.1.206.65:32893): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6284694abb44430b8c9830cbe5597d43: Network error: Client connection negotiation failed: client connection to 127.1.206.65:32893: connect: Connection refused (error 111)
I20260810 14:34:35.703398 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 22176
I20260810 14:34:35.711217 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 21763
2026-08-10T14:34:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (3176 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T14:34:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:35Z Disabled control of system clock
I20260810 14:34:35.746135 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39969
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:45393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:34:35.858654 22384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:35.858927 22384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:35.858963 22384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:35.862879 22384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:35.862936 22384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:35.862951 22384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:35.862967 22384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:35.862982 22384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:35.867671 22384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39969
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:35.868701 22384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:35.870007 22384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:35.878558 22393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:35.878571 22390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:35.878571 22391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:35.878675 22384 server_base.cc:1034] running on GCE node
I20260810 14:34:35.879526 22384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:35.880744 22384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:35.881951 22384 hybrid_clock.cc:648] HybridClock initialized: now 1786372475881915 us; error 44 us; skew 500 ppm
I20260810 14:34:35.884037 22384 webserver.cc:460] Webserver started at http://127.1.206.126:34253/ using document root <none> and password file <none>
I20260810 14:34:35.884722 22384 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:35.884825 22384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:35.885080 22384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:35.887260 22384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "66b1bc51b9c0409aa68967434fdbc87d"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "6c40b78635f8891dd52740dac8ab8236"
server_key_iv: "f77194153b87273ce2d38dae4bc1a0f1"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.887945 22384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "66b1bc51b9c0409aa68967434fdbc87d"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "6c40b78635f8891dd52740dac8ab8236"
server_key_iv: "f77194153b87273ce2d38dae4bc1a0f1"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.892212 22384 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 14:34:35.894788 22400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:35.896019 22384 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:35.896195 22384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "66b1bc51b9c0409aa68967434fdbc87d"
format_stamp: "Formatted at 2026-08-10 14:34:35 on dist-test-slave-0b58"
server_key: "6c40b78635f8891dd52740dac8ab8236"
server_key_iv: "f77194153b87273ce2d38dae4bc1a0f1"
server_key_version: "encryptionkey@0"
I20260810 14:34:35.896382 22384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:35.907694 22384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:35.908581 22384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:35.908797 22384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:35.916466 22384 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39969
I20260810 14:34:35.916474 22459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39969 every 8 connection(s)
I20260810 14:34:35.917472 22384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:35.920668 22460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:35.922400 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 22384
I20260810 14:34:35.922576 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:35.922899 1849 external_mini_cluster.cc:1428] Setting key 466a9dac1fd2a337ff0d6af0e281a81c
I20260810 14:34:35.927665 22460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d: Bootstrap starting.
I20260810 14:34:35.930650 22460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:35.931457 22460 log.cc:824] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:35.932854 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:35.924337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60904 (local address 127.1.206.126:39969)
0810 14:34:35.924991 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:35.925007 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:35.925045 (+ 38us) server_negotiation.cc:407] Connection header received
0810 14:34:35.925726 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:35.925746 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:35.926168 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:35.926469 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:35.926920 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.928008 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.929341 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:35.929833 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:35.929961 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:35.930927 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:35.930932 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:35.930945 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:35.931356 (+ 411us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:35.931414 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:35.931435 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:35.931512 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:35.931771 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 14:34:35.932064 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":137,"threads_started":1}
I20260810 14:34:35.933653 22460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d: No bootstrap required, opened a new log
I20260810 14:34:35.937736 22460 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b1bc51b9c0409aa68967434fdbc87d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39969 } }
I20260810 14:34:35.937971 22460 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:35.938047 22460 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66b1bc51b9c0409aa68967434fdbc87d, State: Initialized, Role: FOLLOWER
I20260810 14:34:35.938462 22460 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b1bc51b9c0409aa68967434fdbc87d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39969 } }
I20260810 14:34:35.938658 22460 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:35.938732 22460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:35.938838 22460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:35.939932 22460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b1bc51b9c0409aa68967434fdbc87d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39969 } }
I20260810 14:34:35.940346 22460 leader_election.cc:302] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66b1bc51b9c0409aa68967434fdbc87d; no voters:
I20260810 14:34:35.940675 22460 leader_election.cc:288] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:35.940805 22466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:35.941064 22466 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [term 1 LEADER]: Becoming Leader. State: Replica: 66b1bc51b9c0409aa68967434fdbc87d, State: Running, Role: LEADER
I20260810 14:34:35.941376 22466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b1bc51b9c0409aa68967434fdbc87d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39969 } }
I20260810 14:34:35.941897 22460 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:35.943005 22467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66b1bc51b9c0409aa68967434fdbc87d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b1bc51b9c0409aa68967434fdbc87d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39969 } } }
I20260810 14:34:35.943141 22467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:35.943403 22470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66b1bc51b9c0409aa68967434fdbc87d. Latest consensus state: current_term: 1 leader_uuid: "66b1bc51b9c0409aa68967434fdbc87d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66b1bc51b9c0409aa68967434fdbc87d" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39969 } } }
I20260810 14:34:35.943495 22470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:35.944051 22477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:35.946816 22477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:35.952201 22477 catalog_manager.cc:1347] Generated new cluster ID: 1f372a143e364e38b18d23f741bd4b22
I20260810 14:34:35.952308 22477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:35.965271 22477 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:35.966215 22477 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:35.973058 22477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d: Generated new TSK 0
I20260810 14:34:35.973760 22477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:35.983322 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39969
--builtin_ntp_servers=127.1.206.84:45393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:34:36.105103 22487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:36.105404 22487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:36.105445 22487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:36.109917 22487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:36.109998 22487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:36.110061 22487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:34:36.115224 22487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:36.116345 22487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:36.117704 22487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:36.127302 22494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:36.127439 22487 server_base.cc:1034] running on GCE node
W20260810 14:34:36.127298 22493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:36.127308 22496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:36.128088 22487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:36.128820 22487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:36.130016 22487 hybrid_clock.cc:648] HybridClock initialized: now 1786372476129983 us; error 47 us; skew 500 ppm
I20260810 14:34:36.131973 22487 webserver.cc:460] Webserver started at http://127.1.206.65:41417/ using document root <none> and password file <none>
I20260810 14:34:36.132637 22487 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:36.132736 22487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:36.132980 22487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:36.135056 22487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "c490a07104244e0486b3d41924f4abe3"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "e748abc92d13b740ec8944a3a0773559"
server_key_iv: "aa27901288b2aa16aaa22e52e048674e"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.135648 22487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "c490a07104244e0486b3d41924f4abe3"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "e748abc92d13b740ec8944a3a0773559"
server_key_iv: "aa27901288b2aa16aaa22e52e048674e"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.139463 22487 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 14:34:36.142153 22502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.143635 22487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:34:36.143764 22487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "c490a07104244e0486b3d41924f4abe3"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "e748abc92d13b740ec8944a3a0773559"
server_key_iv: "aa27901288b2aa16aaa22e52e048674e"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.143862 22487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:36.175351 22487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:36.176074 22487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:36.176244 22487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:36.176949 22487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:36.177911 22487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:36.177958 22487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.178006 22487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:36.178022 22487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.187209 22487 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:36083
I20260810 14:34:36.187229 22629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:36083 every 8 connection(s)
I20260810 14:34:36.188196 22487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:34:36.192034 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 22487
I20260810 14:34:36.192171 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:34:36.192509 1849 external_mini_cluster.cc:1428] Setting key cd6281e307399d6ac6a36e898a5d1f73
I20260810 14:34:36.194818 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39969
--builtin_ntp_servers=127.1.206.84:45393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:34:36.199326 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.190264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:54517 (local address 127.1.206.126:39969)
0810 14:34:36.190444 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.190449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.191616 (+ 1167us) server_negotiation.cc:407] Connection header received
0810 14:34:36.193587 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.193590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.193647 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.193745 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:36.194994 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.195590 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.197236 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.197470 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.197589 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.198794 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:36.198797 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:36.198799 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:36.198812 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:36.198832 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:36.198839 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:36.198920 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.199083 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.199164 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260810 14:34:36.200364 22632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.190715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39969 (local address 127.1.206.65:54517)
0810 14:34:36.191430 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.191481 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.193363 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.193946 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.193953 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.194044 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:36.194812 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.194836 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.195741 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.195747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.197083 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.197093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.197635 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.197640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.197816 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.198493 (+ 677us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:36.198494 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:36.198536 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:36.198604 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:36.198922 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:36.198934 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:36.198942 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.199082 (+ 140us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.199464 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":122,"threads_started":1}
I20260810 14:34:36.201758 22630 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39969
I20260810 14:34:36.202066 22630 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:36.202818 22630 heartbeater.cc:511] Master 127.1.206.126:39969 requested a full tablet report, sending...
I20260810 14:34:36.204895 22421 ts_manager.cc:194] Registered new tserver with Master: c490a07104244e0486b3d41924f4abe3 (127.1.206.65:36083)
I20260810 14:34:36.206704 22421 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.65:54517
W20260810 14:34:36.314728 22633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:36.315016 22633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:36.315056 22633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:36.319006 22633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:36.319067 22633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:36.319123 22633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:34:36.324119 22633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:36.325160 22633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:36.326522 22633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:36.336359 22638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:36.336386 22639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:36.336431 22641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:36.336413 22633 server_base.cc:1034] running on GCE node
I20260810 14:34:36.337085 22633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:36.337741 22633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:36.338927 22633 hybrid_clock.cc:648] HybridClock initialized: now 1786372476338882 us; error 71 us; skew 500 ppm
I20260810 14:34:36.340775 22633 webserver.cc:460] Webserver started at http://127.1.206.66:41327/ using document root <none> and password file <none>
I20260810 14:34:36.341348 22633 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:36.341461 22633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:36.341759 22633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:36.344007 22633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "70a4bf1608e8412482ba8126a6417c6f"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "9687d14f25dabfe5efe1142f4abcf40b"
server_key_iv: "6c2ff8d16ea754aa5f3797280be92e48"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.344655 22633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "70a4bf1608e8412482ba8126a6417c6f"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "9687d14f25dabfe5efe1142f4abcf40b"
server_key_iv: "6c2ff8d16ea754aa5f3797280be92e48"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.348758 22633 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:34:36.351239 22647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.352521 22633 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:34:36.352664 22633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "70a4bf1608e8412482ba8126a6417c6f"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "9687d14f25dabfe5efe1142f4abcf40b"
server_key_iv: "6c2ff8d16ea754aa5f3797280be92e48"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.352792 22633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:36.393723 22633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:36.394438 22633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:36.394654 22633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:36.395267 22633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:36.396220 22633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:36.396317 22633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.396390 22633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:36.396425 22633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.405474 22633 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:38657
I20260810 14:34:36.405494 22770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:38657 every 8 connection(s)
I20260810 14:34:36.406483 22633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:34:36.413276 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 22633
I20260810 14:34:36.413380 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:34:36.413677 1849 external_mini_cluster.cc:1428] Setting key bcadfb650ff095cfc5cb3e056096de21
I20260810 14:34:36.415723 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39969
--builtin_ntp_servers=127.1.206.84:45393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:34:36.416472 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.408391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:54277 (local address 127.1.206.126:39969)
0810 14:34:36.408535 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.408540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.409682 (+ 1142us) server_negotiation.cc:407] Connection header received
0810 14:34:36.411223 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.411227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.411278 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.411356 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:36.412338 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.412865 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.414234 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.414502 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.414604 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.415817 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:36.415821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:36.415823 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:36.415839 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:36.415863 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:36.415873 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:36.415947 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.416158 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.416232 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:34:36.417300 22774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.408844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39969 (local address 127.1.206.66:54277)
0810 14:34:36.409521 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.409564 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.410952 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.411522 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.411529 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.411614 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:36.412098 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.412143 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.413013 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.413016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.414087 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.414105 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.414665 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.414668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.414827 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.415507 (+ 680us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:36.415509 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:36.415552 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:36.415622 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:36.415987 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:36.415996 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:36.416002 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.416118 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.416430 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":127,"threads_started":1}
I20260810 14:34:36.418606 22771 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39969
I20260810 14:34:36.418882 22771 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:36.419471 22771 heartbeater.cc:511] Master 127.1.206.126:39969 requested a full tablet report, sending...
I20260810 14:34:36.420745 22421 ts_manager.cc:194] Registered new tserver with Master: 70a4bf1608e8412482ba8126a6417c6f (127.1.206.66:38657)
I20260810 14:34:36.421591 22421 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.66:54277
W20260810 14:34:36.533069 22775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:36.533349 22775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:36.533391 22775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:36.537499 22775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:36.537569 22775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:36.537627 22775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:34:36.542513 22775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:45393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:36.543691 22775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:36.545188 22775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:34:36.555182 22775 server_base.cc:1034] running on GCE node
W20260810 14:34:36.555150 22781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:36.555146 22783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:36.555140 22780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:36.555843 22775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:36.556551 22775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:36.557736 22775 hybrid_clock.cc:648] HybridClock initialized: now 1786372476557716 us; error 66 us; skew 500 ppm
I20260810 14:34:36.559674 22775 webserver.cc:460] Webserver started at http://127.1.206.67:39243/ using document root <none> and password file <none>
I20260810 14:34:36.560349 22775 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:36.560425 22775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:36.560674 22775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:36.562837 22775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "a5c76d9bde484e6793113250a539f9a8"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "cb70d090b0d79f029a702bdcfcc6f14d"
server_key_iv: "62a3c834e43c1ae69ad5a0711bf33d1e"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.563436 22775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "a5c76d9bde484e6793113250a539f9a8"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "cb70d090b0d79f029a702bdcfcc6f14d"
server_key_iv: "62a3c834e43c1ae69ad5a0711bf33d1e"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.567377 22775 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 14:34:36.569931 22789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.571151 22775 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:34:36.571290 22775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "a5c76d9bde484e6793113250a539f9a8"
format_stamp: "Formatted at 2026-08-10 14:34:36 on dist-test-slave-0b58"
server_key: "cb70d090b0d79f029a702bdcfcc6f14d"
server_key_iv: "62a3c834e43c1ae69ad5a0711bf33d1e"
server_key_version: "encryptionkey@0"
I20260810 14:34:36.571408 22775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:36.615335 22775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:36.616065 22775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:36.616362 22775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:36.616994 22775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:36.617991 22775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:36.618065 22775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.618137 22775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:36.618180 22775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:36.627328 22775 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:38427
I20260810 14:34:36.627353 22912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:38427 every 8 connection(s)
I20260810 14:34:36.628336 22775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:34:36.635804 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 22775
I20260810 14:34:36.635910 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:34:36.636247 1849 external_mini_cluster.cc:1428] Setting key e15afaba9afdb528b05a01f6d6ecdb67
I20260810 14:34:36.638674 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.630401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:59405 (local address 127.1.206.126:39969)
0810 14:34:36.630613 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.630618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.631822 (+ 1204us) server_negotiation.cc:407] Connection header received
0810 14:34:36.633315 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.633317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.633369 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.633457 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:36.634419 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.634959 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.636461 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.636770 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.636900 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.638136 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:36.638142 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:36.638144 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:36.638158 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:36.638186 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:36.638194 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:36.638279 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.638465 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.638533 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260810 14:34:36.639570 22915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.630864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39969 (local address 127.1.206.67:59405)
0810 14:34:36.631642 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.631692 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.633071 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.633673 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.633681 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.633767 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:36.634274 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.634287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.635122 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.635125 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.636243 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.636298 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.636951 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.636956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.637131 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.637853 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:36.637857 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:36.637911 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:36.637977 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:36.638281 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:36.638293 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:36.638300 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.638433 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.638727 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":147,"threads_started":1}
I20260810 14:34:36.640651 22913 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39969
I20260810 14:34:36.640884 22913 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:36.641412 22913 heartbeater.cc:511] Master 127.1.206.126:39969 requested a full tablet report, sending...
I20260810 14:34:36.642504 22421 ts_manager.cc:194] Registered new tserver with Master: a5c76d9bde484e6793113250a539f9a8 (127.1.206.67:38427)
I20260810 14:34:36.643195 22421 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.67:59405
I20260810 14:34:36.650167 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:34:36.656235 22464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.652145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60918 (local address 127.1.206.126:39969)
0810 14:34:36.652325 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.652331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.652475 (+ 144us) server_negotiation.cc:407] Connection header received
0810 14:34:36.652639 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.652643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.652688 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.652782 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:36.653068 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.653589 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.654463 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.654698 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.654806 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.655699 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:36.655703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:36.655706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:36.655718 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:36.655746 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:36.655755 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:36.655916 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.656091 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.656131 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 14:34:36.659017 22421 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:34:36.662029 22421 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:34:36.675964 22925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.670519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.1.206.66:38657)
0810 14:34:36.670876 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.670891 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.670920 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:34:36.671033 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.671039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.671270 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.671437 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:36.671971 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.673141 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.674321 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.675135 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.675265 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.675468 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.675658 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.675770 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":127,"threads_started":1}
I20260810 14:34:36.676249 22924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.670330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:38657 (local address 127.0.0.1:58098)
0810 14:34:36.670689 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.670753 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.670886 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.671638 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.671647 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.671675 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:36.671827 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.671838 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.673256 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.673262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.674166 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.674179 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.675266 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.675269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.675445 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.675491 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.675626 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.675961 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":38,"thread_start_us":84,"threads_started":1}
I20260810 14:34:36.677278 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.671034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:36083 (local address 127.0.0.1:56614)
0810 14:34:36.671777 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.671793 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.671878 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.672657 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.672660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.672679 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:36.672796 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.672803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.674268 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.674271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.675606 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.675617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.676881 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.676884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.676974 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.676995 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.677061 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.677126 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":72,"thread_start_us":89,"threads_started":1}
I20260810 14:34:36.677351 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.671387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56614 (local address 127.1.206.65:36083)
0810 14:34:36.672194 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.672201 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.672226 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:34:36.672323 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.672328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.672501 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.672651 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:36.672928 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.674132 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.675757 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.676761 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.676863 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.677028 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.677087 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.677173 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":91,"threads_started":1}
I20260810 14:34:36.677498 22927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.671359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38427 (local address 127.0.0.1:36058)
0810 14:34:36.672175 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.672186 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.672328 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.672823 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.672826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.672843 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:36.672922 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.672927 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.674268 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.674271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.675720 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.675730 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.677097 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.677101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.677198 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.677220 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.677296 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.677366 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":107,"thread_start_us":90,"threads_started":1}
I20260810 14:34:36.677956 22929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.671537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36058 (local address 127.1.206.67:38427)
0810 14:34:36.672036 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.672048 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.672300 (+ 252us) server_negotiation.cc:407] Connection header received
0810 14:34:36.672440 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.672445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.672628 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.672779 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:36.673036 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.674141 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.675913 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.676755 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.676863 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.677028 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.677670 (+ 642us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.677772 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":148,"threads_started":1}
I20260810 14:34:36.679289 22698 tablet_service.cc:1467] Processing CreateTablet for tablet bd085ada88644c22a2e1267c7b5a1fd4 (DEFAULT_TABLE table=test-table [id=fc22d047774c47ea8b52a6ec53c395ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:36.680190 22698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd085ada88644c22a2e1267c7b5a1fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:36.680063 22841 tablet_service.cc:1467] Processing CreateTablet for tablet bd085ada88644c22a2e1267c7b5a1fd4 (DEFAULT_TABLE table=test-table [id=fc22d047774c47ea8b52a6ec53c395ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:36.680894 22841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd085ada88644c22a2e1267c7b5a1fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:36.684765 22556 tablet_service.cc:1467] Processing CreateTablet for tablet bd085ada88644c22a2e1267c7b5a1fd4 (DEFAULT_TABLE table=test-table [id=fc22d047774c47ea8b52a6ec53c395ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:36.685746 22556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd085ada88644c22a2e1267c7b5a1fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:36.686764 22930 tablet_bootstrap.cc:492] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Bootstrap starting.
I20260810 14:34:36.688774 22931 tablet_bootstrap.cc:492] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Bootstrap starting.
I20260810 14:34:36.689600 22930 tablet_bootstrap.cc:654] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:36.690519 22930 log.cc:824] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:36.691068 22931 tablet_bootstrap.cc:654] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:36.691947 22931 log.cc:824] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:36.692798 22930 tablet_bootstrap.cc:492] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: No bootstrap required, opened a new log
I20260810 14:34:36.693014 22930 ts_tablet_manager.cc:1397] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:34:36.693465 22934 tablet_bootstrap.cc:492] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3: Bootstrap starting.
I20260810 14:34:36.694087 22931 tablet_bootstrap.cc:492] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: No bootstrap required, opened a new log
I20260810 14:34:36.694278 22931 ts_tablet_manager.cc:1397] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 14:34:36.695571 22934 tablet_bootstrap.cc:654] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:36.696326 22934 log.cc:824] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:36.697649 22930 raft_consensus.cc:348] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.697947 22930 raft_consensus.cc:374] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:36.698016 22930 raft_consensus.cc:729] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70a4bf1608e8412482ba8126a6417c6f, State: Initialized, Role: FOLLOWER
I20260810 14:34:36.698061 22934 tablet_bootstrap.cc:492] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3: No bootstrap required, opened a new log
I20260810 14:34:36.698273 22934 ts_tablet_manager.cc:1397] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:34:36.698490 22930 consensus_queue.cc:260] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.698485 22931 raft_consensus.cc:348] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.698735 22931 raft_consensus.cc:374] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:36.698810 22931 raft_consensus.cc:729] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c76d9bde484e6793113250a539f9a8, State: Initialized, Role: FOLLOWER
I20260810 14:34:36.699224 22931 consensus_queue.cc:260] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.699594 22930 ts_tablet_manager.cc:1428] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 14:34:36.699958 22913 heartbeater.cc:503] Master 127.1.206.126:39969 was elected leader, sending a full tablet report...
I20260810 14:34:36.699977 22771 heartbeater.cc:503] Master 127.1.206.126:39969 was elected leader, sending a full tablet report...
I20260810 14:34:36.700138 22931 ts_tablet_manager.cc:1428] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260810 14:34:36.704200 22934 raft_consensus.cc:348] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.704521 22934 raft_consensus.cc:374] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:36.704584 22934 raft_consensus.cc:729] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c490a07104244e0486b3d41924f4abe3, State: Initialized, Role: FOLLOWER
I20260810 14:34:36.705060 22934 consensus_queue.cc:260] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.705684 22630 heartbeater.cc:503] Master 127.1.206.126:39969 was elected leader, sending a full tablet report...
I20260810 14:34:36.705950 22934 ts_tablet_manager.cc:1428] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 14:34:36.790060 22937 raft_consensus.cc:482] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:36.790376 22937 raft_consensus.cc:504] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.791568 22937 leader_election.cc:288] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c490a07104244e0486b3d41924f4abe3 (127.1.206.65:36083), a5c76d9bde484e6793113250a539f9a8 (127.1.206.67:38427)
I20260810 14:34:36.796039 22774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.792035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:36083 (local address 127.1.206.66:37465)
0810 14:34:36.792208 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.792227 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.792366 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.792685 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.792688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.792713 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:36.792854 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.792863 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.793863 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.793867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.794929 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.794939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.795606 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.795610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.795713 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.795745 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.795830 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.795902 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 14:34:36.796039 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.792136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:37465 (local address 127.1.206.65:36083)
0810 14:34:36.792331 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.792336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.792354 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:34:36.792505 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.792509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.792562 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.792660 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:36.793000 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.793755 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.795059 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.795477 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.795613 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.795667 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.795862 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.795934 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 14:34:36.796483 22929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.792548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:38697 (local address 127.1.206.67:38427)
0810 14:34:36.792708 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.792728 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.793022 (+ 294us) server_negotiation.cc:407] Connection header received
0810 14:34:36.793132 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.793135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.793183 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.793260 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:36.793513 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.794192 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.795408 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.795837 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.795973 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.796019 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.796299 (+ 280us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.796369 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 14:34:36.796833 22941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.792446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38427 (local address 127.1.206.66:38697)
0810 14:34:36.792919 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.792936 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:36.793032 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:36.793287 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:36.793288 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:36.793301 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:36.793402 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.793407 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.794295 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.794300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.795277 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:36.795288 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.795973 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.795977 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:36.796074 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.796125 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 14:34:36.796657 (+ 532us) client_negotiation.cc:240] Negotiation successful
0810 14:34:36.796730 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":169,"threads_started":1}
I20260810 14:34:36.796780 22580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd085ada88644c22a2e1267c7b5a1fd4" candidate_uuid: "70a4bf1608e8412482ba8126a6417c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c490a07104244e0486b3d41924f4abe3" is_pre_election: true
I20260810 14:34:36.797127 22580 raft_consensus.cc:2454] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a4bf1608e8412482ba8126a6417c6f in term 0.
I20260810 14:34:36.797449 22862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd085ada88644c22a2e1267c7b5a1fd4" candidate_uuid: "70a4bf1608e8412482ba8126a6417c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c76d9bde484e6793113250a539f9a8" is_pre_election: true
I20260810 14:34:36.797719 22862 raft_consensus.cc:2454] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70a4bf1608e8412482ba8126a6417c6f in term 0.
I20260810 14:34:36.797683 22650 leader_election.cc:302] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70a4bf1608e8412482ba8126a6417c6f, c490a07104244e0486b3d41924f4abe3; no voters:
I20260810 14:34:36.797986 22937 raft_consensus.cc:2781] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:34:36.798079 22937 raft_consensus.cc:482] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:34:36.798134 22937 raft_consensus.cc:3037] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:36.799222 22937 raft_consensus.cc:504] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.799583 22937 leader_election.cc:288] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [CANDIDATE]: Term 1 election: Requested vote from peers c490a07104244e0486b3d41924f4abe3 (127.1.206.65:36083), a5c76d9bde484e6793113250a539f9a8 (127.1.206.67:38427)
I20260810 14:34:36.799979 22580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd085ada88644c22a2e1267c7b5a1fd4" candidate_uuid: "70a4bf1608e8412482ba8126a6417c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c490a07104244e0486b3d41924f4abe3"
I20260810 14:34:36.800088 22862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd085ada88644c22a2e1267c7b5a1fd4" candidate_uuid: "70a4bf1608e8412482ba8126a6417c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c76d9bde484e6793113250a539f9a8"
I20260810 14:34:36.800164 22580 raft_consensus.cc:3037] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:36.800235 22862 raft_consensus.cc:3037] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:36.801456 22862 raft_consensus.cc:2454] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a4bf1608e8412482ba8126a6417c6f in term 1.
I20260810 14:34:36.801505 22580 raft_consensus.cc:2454] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70a4bf1608e8412482ba8126a6417c6f in term 1.
I20260810 14:34:36.801874 22650 leader_election.cc:302] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70a4bf1608e8412482ba8126a6417c6f, a5c76d9bde484e6793113250a539f9a8; no voters:
I20260810 14:34:36.802112 22937 raft_consensus.cc:2781] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:36.802356 22937 raft_consensus.cc:686] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 1 LEADER]: Becoming Leader. State: Replica: 70a4bf1608e8412482ba8126a6417c6f, State: Running, Role: LEADER
I20260810 14:34:36.802742 22937 consensus_queue.cc:237] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } }
I20260810 14:34:36.806125 22421 catalog_manager.cc:5495] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 70a4bf1608e8412482ba8126a6417c6f (127.1.206.66). New cstate: current_term: 1 leader_uuid: "70a4bf1608e8412482ba8126a6417c6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70a4bf1608e8412482ba8126a6417c6f" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 38657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 } health_report { overall_health: UNKNOWN } } }
I20260810 14:34:36.833993 22925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.830067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.1.206.66:38657)
0810 14:34:36.830225 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:36.830230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:36.830247 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:34:36.830403 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:36.830406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:36.830468 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:36.830598 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:34:36.830879 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.831399 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.832387 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:36.832616 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:36.832743 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:36.833088 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:34:36.833514 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:34:36.833684 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:36.833775 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 14:34:36.833815 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 14:34:36.840087 22862 raft_consensus.cc:1261] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 1 FOLLOWER]: Refusing update from remote peer 70a4bf1608e8412482ba8126a6417c6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:36.840158 22580 raft_consensus.cc:1261] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3 [term 1 FOLLOWER]: Refusing update from remote peer 70a4bf1608e8412482ba8126a6417c6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:36.840958 22937 consensus_queue.cc:1035] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c76d9bde484e6793113250a539f9a8" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:36.841176 22942 consensus_queue.cc:1035] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c490a07104244e0486b3d41924f4abe3" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 36083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:36.848393 22946 mvcc.cc:205] Tried to move back new op lower bound from 7316981665129480192 to 7316981664986882048. Current Snapshot: MvccSnapshot[applied={T|T < 7316981665129480192}]
I20260810 14:34:36.848917 22945 mvcc.cc:205] Tried to move back new op lower bound from 7316981665129480192 to 7316981664986882048. Current Snapshot: MvccSnapshot[applied={T|T < 7316981665129480192}]
I20260810 14:34:36.859818 22417 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:36.860018 22417 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:36.862627 22417 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66b1bc51b9c0409aa68967434fdbc87d: Sending DeleteTablet for 3 replicas of tablet bd085ada88644c22a2e1267c7b5a1fd4
I20260810 14:34:36.863392 22698 tablet_service.cc:1514] Processing DeleteTablet for tablet bd085ada88644c22a2e1267c7b5a1fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:36 UTC) from {username='slave'} at 127.0.0.1:58098
I20260810 14:34:36.863629 22841 tablet_service.cc:1514] Processing DeleteTablet for tablet bd085ada88644c22a2e1267c7b5a1fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:36 UTC) from {username='slave'} at 127.0.0.1:36058
I20260810 14:34:36.863773 22556 tablet_service.cc:1514] Processing DeleteTablet for tablet bd085ada88644c22a2e1267c7b5a1fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:36 UTC) from {username='slave'} at 127.0.0.1:56614
I20260810 14:34:36.863890 22956 tablet_replica.cc:330] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: stopping tablet replica
I20260810 14:34:36.864205 22956 raft_consensus.cc:2229] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:34:36.864519 22958 tablet_replica.cc:330] T bd085ada88644c22a2e1267c7b5a1fd4 P c490a07104244e0486b3d41924f4abe3: stopping tablet replica
I20260810 14:34:36.864653 22956 raft_consensus.cc:2258] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:36.865012 22957 tablet_replica.cc:330] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: stopping tablet replica
I20260810 14:34:36.865053 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 22487
I20260810 14:34:36.865280 22957 raft_consensus.cc:2229] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:36.865542 22957 raft_consensus.cc:2258] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:36.872020 22956 ts_tablet_manager.cc:1905] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:36.872396 22957 ts_tablet_manager.cc:1905] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:36.875247 22957 ts_tablet_manager.cc:1918] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:36.875363 22957 log.cc:1196] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/bd085ada88644c22a2e1267c7b5a1fd4
I20260810 14:34:36.875720 22957 ts_tablet_manager.cc:1939] T bd085ada88644c22a2e1267c7b5a1fd4 P a5c76d9bde484e6793113250a539f9a8: Deleting consensus metadata
I20260810 14:34:36.875695 22956 ts_tablet_manager.cc:1918] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:36.875813 22956 log.cc:1196] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/bd085ada88644c22a2e1267c7b5a1fd4
I20260810 14:34:36.876494 22956 ts_tablet_manager.cc:1939] T bd085ada88644c22a2e1267c7b5a1fd4 P 70a4bf1608e8412482ba8126a6417c6f: Deleting consensus metadata
I20260810 14:34:36.877170 22403 catalog_manager.cc:4841] TS a5c76d9bde484e6793113250a539f9a8 (127.1.206.67:38427): tablet bd085ada88644c22a2e1267c7b5a1fd4 (table test-table [id=fc22d047774c47ea8b52a6ec53c395ec]) successfully deleted
I20260810 14:34:36.877689 22403 catalog_manager.cc:4841] TS 70a4bf1608e8412482ba8126a6417c6f (127.1.206.66:38657): tablet bd085ada88644c22a2e1267c7b5a1fd4 (table test-table [id=fc22d047774c47ea8b52a6ec53c395ec]) successfully deleted
W20260810 14:34:36.878661 22403 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:36083 (error 108)
I20260810 14:34:36.879619 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 22633
I20260810 14:34:36.879830 22927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:36.879500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:36083 (local address 127.0.0.1:56622)
0810 14:34:36.879637 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:36.879724 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:36083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 14:34:36.882184 22403 catalog_manager.cc:4584] TS c490a07104244e0486b3d41924f4abe3 (127.1.206.65:36083): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd085ada88644c22a2e1267c7b5a1fd4: Network error: Client connection negotiation failed: client connection to 127.1.206.65:36083: connect: Connection refused (error 111)
I20260810 14:34:36.887279 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 22775
I20260810 14:34:36.896096 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 22384
2026-08-10T14:34:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1183 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:36 dist-test-slave-0b58 krb5kdc[22962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:36 dist-test-slave-0b58 krb5kdc[22962](info): set up 2 sockets
Aug 10 14:34:36 dist-test-slave-0b58 krb5kdc[22962](info): commencing operation
krb5kdc: starting...
W20260810 14:34:37.991569 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:38 dist-test-slave-0b58 krb5kdc[22962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:34:38.119302 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39703
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:39703
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:38.239212 22975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:38.239629 22975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:38.239706 22975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:38.243892 22975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:38.243983 22975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:38.244024 22975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:38.244058 22975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:38.244092 22975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:38.249511 22975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:39703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:39703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:38.250550 22975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:38.251596 22975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:38.259980 22982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:38.260001 22984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:38.259984 22981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:38.260123 22975 server_base.cc:1034] running on GCE node
I20260810 14:34:38.260841 22975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:38.261868 22975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:38.263067 22975 hybrid_clock.cc:648] HybridClock initialized: now 1786372478263047 us; error 33 us; skew 500 ppm
Aug 10 14:34:38 dist-test-slave-0b58 krb5kdc[22962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372478, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:38.265900 22975 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:34:38.266830 22975 webserver.cc:460] Webserver started at http://127.1.206.126:37755/ using document root <none> and password file <none>
I20260810 14:34:38.267377 22975 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:38.267439 22975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:38.267660 22975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:38.269747 22975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "8ac3936aff464642ad77382a9d0d44df"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "ba5fd3306a00961c427e17e0f7528c92"
server_key_iv: "36c2315227ef283b78322ca83c56ed3b"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.270324 22975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "8ac3936aff464642ad77382a9d0d44df"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "ba5fd3306a00961c427e17e0f7528c92"
server_key_iv: "36c2315227ef283b78322ca83c56ed3b"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.274024 22975 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 14:34:38.276448 22993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:38.277626 22975 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:38.277778 22975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "8ac3936aff464642ad77382a9d0d44df"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "ba5fd3306a00961c427e17e0f7528c92"
server_key_iv: "36c2315227ef283b78322ca83c56ed3b"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.277879 22975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:38.289572 22975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:38.292747 22975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:38.292972 22975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:38.300414 22975 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:39703
I20260810 14:34:38.300467 23050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:39703 every 8 connection(s)
I20260810 14:34:38.301409 22975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:38.304214 23051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:38.306348 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 22975
I20260810 14:34:38.306504 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:38.306835 1849 external_mini_cluster.cc:1428] Setting key 9075f91a402abc3668543dcadd78a6b8
I20260810 14:34:38.311031 23051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df: Bootstrap starting.
I20260810 14:34:38.313398 23051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:38.314360 23051 log.cc:824] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:34:38 dist-test-slave-0b58 krb5kdc[22962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:38.316673 23051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df: No bootstrap required, opened a new log
I20260810 14:34:38.320497 23051 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac3936aff464642ad77382a9d0d44df" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39703 } }
I20260810 14:34:38.320760 23051 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:38.320842 23051 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac3936aff464642ad77382a9d0d44df, State: Initialized, Role: FOLLOWER
I20260810 14:34:38.321291 23051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac3936aff464642ad77382a9d0d44df" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39703 } }
I20260810 14:34:38.321412 23051 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:38.321496 23051 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:38.321527 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:38.308320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49130 (local address 127.1.206.126:39703)
0810 14:34:38.308770 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:38.308785 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:38.308820 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:34:38.309493 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:38.309510 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:38.309829 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:38.310170 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:38.311013 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.312038 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.312974 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.313491 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.313681 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:38.316663 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:38.316668 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:38.316680 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:38.316707 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:38.318404 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:38.318866 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:38.318871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:38.318875 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:38.319010 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:38.319317 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:38.319320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:38.319322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:38.319728 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:38.319945 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:38.320191 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 14:34:38.320535 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":148,"threads_started":1}
I20260810 14:34:38.321620 23051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:38.322587 23051 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac3936aff464642ad77382a9d0d44df" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39703 } }
I20260810 14:34:38.322950 23051 leader_election.cc:302] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ac3936aff464642ad77382a9d0d44df; no voters:
I20260810 14:34:38.323280 23051 leader_election.cc:288] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:38.323423 23056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:38.323691 23056 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [term 1 LEADER]: Becoming Leader. State: Replica: 8ac3936aff464642ad77382a9d0d44df, State: Running, Role: LEADER
I20260810 14:34:38.324035 23056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac3936aff464642ad77382a9d0d44df" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39703 } }
I20260810 14:34:38.324542 23051 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:38.325670 23057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ac3936aff464642ad77382a9d0d44df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac3936aff464642ad77382a9d0d44df" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39703 } } }
I20260810 14:34:38.325805 23057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:38.326195 23058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ac3936aff464642ad77382a9d0d44df. Latest consensus state: current_term: 1 leader_uuid: "8ac3936aff464642ad77382a9d0d44df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac3936aff464642ad77382a9d0d44df" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 39703 } } }
I20260810 14:34:38.326924 23065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:38.327092 23058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:38.329767 23065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:38.335649 23065 catalog_manager.cc:1347] Generated new cluster ID: 6fa15efe0c4c4d8ea6bf5ada769c34e3
I20260810 14:34:38.335752 23065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:38.349538 23065 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:38.350531 23065 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:38.357234 23065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df: Generated new TSK 0
I20260810 14:34:38.357966 23065 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.206.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
Entry for principal kudu/127.1.206.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab.
I20260810 14:34:38.393708 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39703
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:38.509199 23080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:38.509469 23080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:38.509514 23080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:38.513605 23080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:38.513671 23080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:38.513731 23080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:34:38.518944 23080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.65.keytab
--principal=kudu/127.1.206.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:38.519937 23080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:38.521009 23080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:38.531234 23085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:38.531248 23088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:38.531234 23086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:38.531462 23080 server_base.cc:1034] running on GCE node
I20260810 14:34:38.531985 23080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:38.532776 23080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:38.533974 23080 hybrid_clock.cc:648] HybridClock initialized: now 1786372478533957 us; error 28 us; skew 500 ppm
Aug 10 14:34:38 dist-test-slave-0b58 krb5kdc[22962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372478, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:38.536939 23080 init.cc:377] Logged in from keytab as kudu/127.1.206.65@KRBTEST.COM (short username kudu)
I20260810 14:34:38.537866 23080 webserver.cc:460] Webserver started at http://127.1.206.65:40793/ using document root <none> and password file <none>
I20260810 14:34:38.538393 23080 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:38.538456 23080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:38.538622 23080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:38.540737 23080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "1950d2dd64b14836917d87b84686396d"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "903075ca690a8b60428f15e518680e11"
server_key_iv: "2dffdcf457dfb00a6e275910b4b73a23"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.541272 23080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "1950d2dd64b14836917d87b84686396d"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "903075ca690a8b60428f15e518680e11"
server_key_iv: "2dffdcf457dfb00a6e275910b4b73a23"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.545102 23080 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:34:38.547520 23095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:38.548828 23080 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:34:38.548964 23080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "1950d2dd64b14836917d87b84686396d"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "903075ca690a8b60428f15e518680e11"
server_key_iv: "2dffdcf457dfb00a6e275910b4b73a23"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.549078 23080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:38.591037 23080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:38.594097 23080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:38.594322 23080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:38.594936 23080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:38.595770 23080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:38.595842 23080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:38.595917 23080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:38.595953 23080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:38.605516 23080 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:43787
I20260810 14:34:38.605541 23223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:43787 every 8 connection(s)
I20260810 14:34:38.606442 23080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:34:38.611819 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 23080
I20260810 14:34:38.611972 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:34:38.612360 1849 external_mini_cluster.cc:1428] Setting key ba1a5fe04320a14a68a53fcf3242243b
Aug 10 14:34:38 dist-test-slave-0b58 krb5kdc[22962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372478, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.65@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:38.621520 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:38.608349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:43273 (local address 127.1.206.126:39703)
0810 14:34:38.608499 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:38.608503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:38.609401 (+ 898us) server_negotiation.cc:407] Connection header received
0810 14:34:38.610306 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:38.610309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:38.610365 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:38.610449 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:38.611623 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.612359 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.613909 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.614151 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.614238 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:38.617538 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:38.617541 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:38.617543 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:38.617567 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:38.619147 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:38.619831 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:38.619834 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:38.619835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:38.619910 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:38.620342 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:38.620344 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:38.620345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:38.620522 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:38.620603 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:38.621300 (+ 697us) server_negotiation.cc:299] Negotiation successful
0810 14:34:38.621403 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 14:34:38.622737 23226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:38.608766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39703 (local address 127.1.206.65:43273)
0810 14:34:38.609251 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:38.609294 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:38.610095 (+ 801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:38.610618 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:38.610624 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:38.610975 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:38.611446 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:38.611460 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.612547 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.612551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:38.613786 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:38.613796 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.614319 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.614324 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:38.614550 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:38.615204 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:38.615229 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:38.617362 (+ 2133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:38.619303 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:38.619313 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:38.619331 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:38.619724 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:38.620008 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:38.620014 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:38.620019 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:38.620225 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:38.620639 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:38.620649 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:38.621020 (+ 371us) client_negotiation.cc:769] Sending connection context
0810 14:34:38.621258 (+ 238us) client_negotiation.cc:240] Negotiation successful
0810 14:34:38.621623 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.1.206.66@KRBTEST.COM; defaulting to no policy
I20260810 14:34:38.624055 23224 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39703
I20260810 14:34:38.624353 23224 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:38.624925 23224 heartbeater.cc:511] Master 127.1.206.126:39703 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.66@KRBTEST.COM" created.
I20260810 14:34:38.626700 23006 ts_manager.cc:194] Registered new tserver with Master: 1950d2dd64b14836917d87b84686396d (127.1.206.65:43787)
I20260810 14:34:38.627897 23006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.65@KRBTEST.COM'} at 127.1.206.65:43273
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
Entry for principal kudu/127.1.206.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab.
I20260810 14:34:38.642761 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39703
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:38.773062 23229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:38.773388 23229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:38.773466 23229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:38.777642 23229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:38.777741 23229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:38.777829 23229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:34:38.783542 23229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.66.keytab
--principal=kudu/127.1.206.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:38.784677 23229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:38.785718 23229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:38.795647 23236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:38.795614 23238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:38.796010 23235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:38.796041 23229 server_base.cc:1034] running on GCE node
I20260810 14:34:38.796761 23229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:38.797494 23229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:38.798683 23229 hybrid_clock.cc:648] HybridClock initialized: now 1786372478798648 us; error 48 us; skew 500 ppm
Aug 10 14:34:38 dist-test-slave-0b58 krb5kdc[22962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372478, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:38.801615 23229 init.cc:377] Logged in from keytab as kudu/127.1.206.66@KRBTEST.COM (short username kudu)
I20260810 14:34:38.802603 23229 webserver.cc:460] Webserver started at http://127.1.206.66:42091/ using document root <none> and password file <none>
I20260810 14:34:38.803191 23229 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:38.803288 23229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:38.803530 23229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:38.805698 23229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "f8862f2d1e51437db0288f37fe021da0"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "7a3f4d3c2af482156c2eadd77d24739c"
server_key_iv: "5b2158b401337b99498d879fc9287084"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.806321 23229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "f8862f2d1e51437db0288f37fe021da0"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "7a3f4d3c2af482156c2eadd77d24739c"
server_key_iv: "5b2158b401337b99498d879fc9287084"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.810318 23229 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:38.812965 23246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:38.814239 23229 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:34:38.814389 23229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "f8862f2d1e51437db0288f37fe021da0"
format_stamp: "Formatted at 2026-08-10 14:34:38 on dist-test-slave-0b58"
server_key: "7a3f4d3c2af482156c2eadd77d24739c"
server_key_iv: "5b2158b401337b99498d879fc9287084"
server_key_version: "encryptionkey@0"
I20260810 14:34:38.814518 23229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:38.828568 23229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:38.832122 23229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:38.832399 23229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:38.833048 23229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:38.833899 23229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:38.833971 23229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:38.834044 23229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:38.834095 23229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:38.843189 23229 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:44421
I20260810 14:34:38.843209 23370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:44421 every 8 connection(s)
I20260810 14:34:38.844115 23229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:34:38.850625 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 23229
I20260810 14:34:38.850791 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:34:38.851132 1849 external_mini_cluster.cc:1428] Setting key 5015671600dea83f460487fd570e59b6
Aug 10 14:34:38 dist-test-slave-0b58 krb5kdc[22962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372478, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.66@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:38.858471 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:38.846023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:48709 (local address 127.1.206.126:39703)
0810 14:34:38.846214 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:38.846219 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:38.847115 (+ 896us) server_negotiation.cc:407] Connection header received
0810 14:34:38.847945 (+ 830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:38.847948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:38.847994 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:38.848070 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:38.849267 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.849792 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.851050 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.851399 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.851533 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:38.854306 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:38.854313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:38.854318 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:38.854354 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:38.855936 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:38.856622 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:38.856625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:38.856626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:38.856708 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:38.857174 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:38.857177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:38.857178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:38.857448 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:38.857544 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:38.858243 (+ 699us) server_negotiation.cc:299] Negotiation successful
0810 14:34:38.858351 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260810 14:34:38.859741 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:38.846496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39703 (local address 127.1.206.66:48709)
0810 14:34:38.846955 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:38.846998 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:38.847755 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:38.848293 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:38.848300 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:38.848654 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:38.849118 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:38.849131 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.849911 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.849913 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:38.850929 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:38.850939 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:38.851584 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:38.851588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:38.851787 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:38.852573 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:38.852596 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:38.854136 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:38.856058 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:38.856067 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:38.856085 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:38.856506 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:38.856828 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:38.856833 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:38.856838 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:38.857052 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:38.857575 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:38.857586 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:38.857954 (+ 368us) client_negotiation.cc:769] Sending connection context
0810 14:34:38.858187 (+ 233us) client_negotiation.cc:240] Negotiation successful
0810 14:34:38.858585 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":119,"threads_started":1}
I20260810 14:34:38.861090 23371 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39703
I20260810 14:34:38.861346 23371 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:38.861878 23371 heartbeater.cc:511] Master 127.1.206.126:39703 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.206.67@KRBTEST.COM; defaulting to no policy
I20260810 14:34:38.863008 23006 ts_manager.cc:194] Registered new tserver with Master: f8862f2d1e51437db0288f37fe021da0 (127.1.206.66:44421)
I20260810 14:34:38.863592 23006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.66@KRBTEST.COM'} at 127.1.206.66:48709
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
Entry for principal kudu/127.1.206.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab.
I20260810 14:34:38.883955 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39703
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:34185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:38.997603 23376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:38.997905 23376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:38.997983 23376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:39.002069 23376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:39.002183 23376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:39.002282 23376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:34:39.007758 23376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:34185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.67.keytab
--principal=kudu/127.1.206.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:39703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:39.008931 23376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:39.010000 23376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:39.019780 23383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:39.019795 23384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:39.019776 23386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:39.020155 23376 server_base.cc:1034] running on GCE node
I20260810 14:34:39.020599 23376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:39.021314 23376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:39.022504 23376 hybrid_clock.cc:648] HybridClock initialized: now 1786372479022485 us; error 35 us; skew 500 ppm
Aug 10 14:34:39 dist-test-slave-0b58 krb5kdc[22962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372479, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:39.025545 23376 init.cc:377] Logged in from keytab as kudu/127.1.206.67@KRBTEST.COM (short username kudu)
I20260810 14:34:39.026564 23376 webserver.cc:460] Webserver started at http://127.1.206.67:43577/ using document root <none> and password file <none>
I20260810 14:34:39.027143 23376 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:39.027206 23376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:39.027421 23376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:39.029675 23376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "9cebf4bac46a4031943d84278207955e"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "9cba9d03a9d91b7402ecce910644a79f"
server_key_iv: "d3609648f1f16049a55fcba5628a715d"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.030272 23376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "9cebf4bac46a4031943d84278207955e"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "9cba9d03a9d91b7402ecce910644a79f"
server_key_iv: "d3609648f1f16049a55fcba5628a715d"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.034412 23376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:39.037052 23394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.038384 23376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:39.038535 23376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "9cebf4bac46a4031943d84278207955e"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "9cba9d03a9d91b7402ecce910644a79f"
server_key_iv: "d3609648f1f16049a55fcba5628a715d"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.038657 23376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:39.057842 23376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:39.060789 23376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:39.061012 23376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:39.061607 23376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:39.062431 23376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:39.062479 23376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.062546 23376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:39.062587 23376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.071575 23376 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:41597
I20260810 14:34:39.071601 23513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:41597 every 8 connection(s)
I20260810 14:34:39.072531 23376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:34:39.081357 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 23376
I20260810 14:34:39.081527 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:34:39.081883 1849 external_mini_cluster.cc:1428] Setting key b690b72983f3315e28c6e4bb2c6e8db5
Aug 10 14:34:39 dist-test-slave-0b58 krb5kdc[22962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372479, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.67@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:39.086964 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.074346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:35715 (local address 127.1.206.126:39703)
0810 14:34:39.074501 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.074505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.075381 (+ 876us) server_negotiation.cc:407] Connection header received
0810 14:34:39.076846 (+ 1465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.076850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.076915 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.077039 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:39.078228 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.078766 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.079932 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.080164 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.080310 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.083140 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:39.083144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:39.083146 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:39.083172 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:39.084872 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:39.085413 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:39.085416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:39.085418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:39.085507 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:39.085856 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:39.085860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:39.085862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:39.086051 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:39.086186 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.086687 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.086807 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 14:34:39.087777 23516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.074674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:39703 (local address 127.1.206.67:35715)
0810 14:34:39.075205 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.075250 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.076508 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.077221 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.077229 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.077589 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:39.078077 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.078090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.078909 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.078912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.079801 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.079810 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.080345 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.080349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.080551 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.081181 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:34:39.081197 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:39.082957 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:39.084997 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:39.085002 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:39.085018 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:39.085294 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:39.085600 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:34:39.085604 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:34:39.085606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:34:39.085757 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:34:39.086185 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:39.086192 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:39.086442 (+ 250us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.086643 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.086973 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":130,"threads_started":1}
I20260810 14:34:39.088924 23514 heartbeater.cc:347] Connected to a master server at 127.1.206.126:39703
I20260810 14:34:39.089188 23514 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:39.089682 23514 heartbeater.cc:511] Master 127.1.206.126:39703 requested a full tablet report, sending...
I20260810 14:34:39.090772 23006 ts_manager.cc:194] Registered new tserver with Master: 9cebf4bac46a4031943d84278207955e (127.1.206.67:41597)
I20260810 14:34:39.091358 23006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.206.67@KRBTEST.COM'} at 127.1.206.67:35715
I20260810 14:34:39.096093 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:34:39.105523 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.098188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49146 (local address 127.1.206.126:39703)
0810 14:34:39.098332 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.098336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.098521 (+ 185us) server_negotiation.cc:407] Connection header received
0810 14:34:39.098619 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.098621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.098658 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.098722 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:39.099387 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.099888 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.100828 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.101064 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.101189 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.102605 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:39.102608 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:39.102610 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:39.102632 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:39.103916 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:39.104427 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:39.104430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:39.104431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:39.104507 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:39.104771 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:39.104774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:39.104775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:39.104981 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:39.105082 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.105312 (+ 230us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.105407 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 14:34:39.108583 23006 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:34:39.111753 23006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:34:39.127679 23528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.121129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:41597 (local address 127.0.0.1:38992)
0810 14:34:39.121906 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.121959 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.122134 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.123124 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.123130 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.123154 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:39.123344 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.123352 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.124562 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.124565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.126106 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.126116 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.127041 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.127045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.127164 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.127240 (+ 76us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.127385 (+ 145us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.127516 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":252,"thread_start_us":95,"threads_started":1}
I20260810 14:34:39.128002 23532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.122470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35788 (local address 127.1.206.65:43787)
0810 14:34:39.123461 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.123480 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.123503 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:34:39.123574 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.123579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.123760 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.123906 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:39.124163 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.125279 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.126532 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.127376 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.127503 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.127641 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.127749 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.127856 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":882,"thread_start_us":123,"threads_started":1}
I20260810 14:34:39.128399 23531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.122286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:43787 (local address 127.0.0.1:35788)
0810 14:34:39.122526 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.122540 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.122620 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.123910 (+ 1290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.123913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.123931 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:39.124041 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.124047 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.125397 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.125400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.126400 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.126411 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.127501 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.127505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.127599 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.127622 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.127710 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.128223 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":107,"threads_started":1}
I20260810 14:34:39.128463 23529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.121292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38992 (local address 127.1.206.67:41597)
0810 14:34:39.121953 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.121966 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.122036 (+ 70us) server_negotiation.cc:407] Connection header received
0810 14:34:39.122819 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.122824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.122967 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.123315 (+ 348us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:39.123488 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.124431 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.126225 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.126907 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.127029 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.127186 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.128184 (+ 998us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.128323 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":135,"threads_started":1}
I20260810 14:34:39.129016 23530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.121452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57410 (local address 127.1.206.66:44421)
0810 14:34:39.121763 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.121776 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.122499 (+ 723us) server_negotiation.cc:407] Connection header received
0810 14:34:39.122755 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.122767 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.122928 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.123029 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:39.123524 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.124776 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.127372 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.128199 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.128332 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.128460 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.128769 (+ 309us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.128862 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":86,"threads_started":1}
I20260810 14:34:39.128858 23527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.121233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:44421 (local address 127.0.0.1:57410)
0810 14:34:39.122398 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.122414 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.122576 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.123189 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.123191 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.123205 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:39.123379 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.123391 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.124968 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.124971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.127223 (+ 2252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.127240 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.128533 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.128539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.128635 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.128653 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.128715 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.128766 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"mutex_wait_us":90,"thread_start_us":109,"threads_started":1}
I20260810 14:34:39.132229 23443 tablet_service.cc:1467] Processing CreateTablet for tablet 3625bcb2e9e84639987ee994d2d50ec1 (DEFAULT_TABLE table=test-table [id=6bcbda494791432a9e2fc74c4bcf409e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:39.132615 23150 tablet_service.cc:1467] Processing CreateTablet for tablet 3625bcb2e9e84639987ee994d2d50ec1 (DEFAULT_TABLE table=test-table [id=6bcbda494791432a9e2fc74c4bcf409e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:39.133558 23150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3625bcb2e9e84639987ee994d2d50ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:39.133564 23443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3625bcb2e9e84639987ee994d2d50ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:39.138646 23299 tablet_service.cc:1467] Processing CreateTablet for tablet 3625bcb2e9e84639987ee994d2d50ec1 (DEFAULT_TABLE table=test-table [id=6bcbda494791432a9e2fc74c4bcf409e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:39.139678 23299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3625bcb2e9e84639987ee994d2d50ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:39.141889 23534 tablet_bootstrap.cc:492] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Bootstrap starting.
I20260810 14:34:39.144381 23533 tablet_bootstrap.cc:492] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d: Bootstrap starting.
I20260810 14:34:39.144872 23534 tablet_bootstrap.cc:654] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:39.145793 23534 log.cc:824] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:39.146392 23533 tablet_bootstrap.cc:654] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:39.147130 23533 log.cc:824] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:39.148088 23534 tablet_bootstrap.cc:492] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: No bootstrap required, opened a new log
I20260810 14:34:39.148391 23534 ts_tablet_manager.cc:1397] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.005s
I20260810 14:34:39.148486 23538 tablet_bootstrap.cc:492] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Bootstrap starting.
I20260810 14:34:39.148948 23533 tablet_bootstrap.cc:492] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d: No bootstrap required, opened a new log
I20260810 14:34:39.149142 23533 ts_tablet_manager.cc:1397] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260810 14:34:39.151038 23538 tablet_bootstrap.cc:654] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:39.151908 23538 log.cc:824] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:39.152832 23534 raft_consensus.cc:348] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.153129 23534 raft_consensus.cc:374] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:39.153191 23534 raft_consensus.cc:729] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cebf4bac46a4031943d84278207955e, State: Initialized, Role: FOLLOWER
I20260810 14:34:39.153429 23533 raft_consensus.cc:348] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.153668 23533 raft_consensus.cc:374] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:39.153738 23533 raft_consensus.cc:729] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1950d2dd64b14836917d87b84686396d, State: Initialized, Role: FOLLOWER
I20260810 14:34:39.153685 23534 consensus_queue.cc:260] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.154201 23538 tablet_bootstrap.cc:492] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: No bootstrap required, opened a new log
I20260810 14:34:39.154147 23533 consensus_queue.cc:260] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.154392 23538 ts_tablet_manager.cc:1397] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:34:39.154477 23514 heartbeater.cc:503] Master 127.1.206.126:39703 was elected leader, sending a full tablet report...
I20260810 14:34:39.154745 23534 ts_tablet_manager.cc:1428] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 14:34:39.155079 23533 ts_tablet_manager.cc:1428] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:34:39.155277 23224 heartbeater.cc:503] Master 127.1.206.126:39703 was elected leader, sending a full tablet report...
I20260810 14:34:39.157655 23538 raft_consensus.cc:348] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.157922 23538 raft_consensus.cc:374] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:39.157980 23538 raft_consensus.cc:729] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8862f2d1e51437db0288f37fe021da0, State: Initialized, Role: FOLLOWER
I20260810 14:34:39.158398 23538 consensus_queue.cc:260] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.159041 23371 heartbeater.cc:503] Master 127.1.206.126:39703 was elected leader, sending a full tablet report...
I20260810 14:34:39.159338 23538 ts_tablet_manager.cc:1428] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 14:34:39.159795 23542 raft_consensus.cc:482] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:39.159941 23542 raft_consensus.cc:504] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.161054 23542 leader_election.cc:288] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cebf4bac46a4031943d84278207955e (127.1.206.67:41597), 1950d2dd64b14836917d87b84686396d (127.1.206.65:43787)
I20260810 14:34:39.164960 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.161287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:43787 (local address 127.1.206.66:59193)
0810 14:34:39.161574 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.161590 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.161693 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.161979 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.161982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.161997 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:39.162119 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.162125 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.162979 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.162985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.163755 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.163764 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.164500 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.164503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.164614 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.164635 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.164739 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.164817 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"spinlock_wait_cycles":7040,"thread_start_us":121,"threads_started":1}
I20260810 14:34:39.164955 23532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.161372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:59193 (local address 127.1.206.65:43787)
0810 14:34:39.161483 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.161488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.161783 (+ 295us) server_negotiation.cc:407] Connection header received
0810 14:34:39.161835 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.161838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.161879 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.161969 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:39.162238 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.162874 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.163881 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.164384 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.164508 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.164560 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.164747 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.164819 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:34:39.165117 23529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.161493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:55859 (local address 127.1.206.67:41597)
0810 14:34:39.161614 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.161618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.161636 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:34:39.161872 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.161876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.161926 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.162015 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:39.162407 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.162985 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.164011 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.164517 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.164677 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.164728 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.164940 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.165009 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 14:34:39.165128 23543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.161215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:41597 (local address 127.1.206.66:55859)
0810 14:34:39.161574 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.161591 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.161693 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.162134 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.162137 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.162161 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:39.162298 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.162308 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.163095 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.163102 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.163883 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.163892 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.164678 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.164681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.164809 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.164836 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.164925 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.164998 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"spinlock_wait_cycles":22784}
I20260810 14:34:39.165575 23173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3625bcb2e9e84639987ee994d2d50ec1" candidate_uuid: "f8862f2d1e51437db0288f37fe021da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1950d2dd64b14836917d87b84686396d" is_pre_election: true
I20260810 14:34:39.165652 23464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3625bcb2e9e84639987ee994d2d50ec1" candidate_uuid: "f8862f2d1e51437db0288f37fe021da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cebf4bac46a4031943d84278207955e" is_pre_election: true
I20260810 14:34:39.165889 23173 raft_consensus.cc:2454] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8862f2d1e51437db0288f37fe021da0 in term 0.
I20260810 14:34:39.165949 23464 raft_consensus.cc:2454] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8862f2d1e51437db0288f37fe021da0 in term 0.
I20260810 14:34:39.166379 23248 leader_election.cc:302] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1950d2dd64b14836917d87b84686396d, f8862f2d1e51437db0288f37fe021da0; no voters:
I20260810 14:34:39.166646 23542 raft_consensus.cc:2781] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:34:39.166733 23542 raft_consensus.cc:482] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:34:39.166764 23542 raft_consensus.cc:3037] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:39.167744 23542 raft_consensus.cc:504] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.168081 23542 leader_election.cc:288] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [CANDIDATE]: Term 1 election: Requested vote from peers 9cebf4bac46a4031943d84278207955e (127.1.206.67:41597), 1950d2dd64b14836917d87b84686396d (127.1.206.65:43787)
I20260810 14:34:39.168418 23464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3625bcb2e9e84639987ee994d2d50ec1" candidate_uuid: "f8862f2d1e51437db0288f37fe021da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cebf4bac46a4031943d84278207955e"
I20260810 14:34:39.168486 23173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3625bcb2e9e84639987ee994d2d50ec1" candidate_uuid: "f8862f2d1e51437db0288f37fe021da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1950d2dd64b14836917d87b84686396d"
I20260810 14:34:39.168551 23464 raft_consensus.cc:3037] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:39.168622 23173 raft_consensus.cc:3037] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:39.169584 23464 raft_consensus.cc:2454] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8862f2d1e51437db0288f37fe021da0 in term 1.
I20260810 14:34:39.169616 23173 raft_consensus.cc:2454] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8862f2d1e51437db0288f37fe021da0 in term 1.
I20260810 14:34:39.169966 23250 leader_election.cc:302] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cebf4bac46a4031943d84278207955e, f8862f2d1e51437db0288f37fe021da0; no voters:
I20260810 14:34:39.170189 23542 raft_consensus.cc:2781] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:39.170429 23542 raft_consensus.cc:686] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 1 LEADER]: Becoming Leader. State: Replica: f8862f2d1e51437db0288f37fe021da0, State: Running, Role: LEADER
I20260810 14:34:39.170784 23542 consensus_queue.cc:237] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } }
I20260810 14:34:39.173887 23006 catalog_manager.cc:5495] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8862f2d1e51437db0288f37fe021da0 (127.1.206.66). New cstate: current_term: 1 leader_uuid: "f8862f2d1e51437db0288f37fe021da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8862f2d1e51437db0288f37fe021da0" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 44421 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 } health_report { overall_health: UNKNOWN } } }
I20260810 14:34:39.191622 23530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.188024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57418 (local address 127.1.206.66:44421)
0810 14:34:39.188171 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.188176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.188193 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:34:39.188317 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.188319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.188374 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.188494 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:34:39.188764 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.189287 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.190163 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.190387 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.190500 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.190816 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:34:39.191219 (+ 403us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:34:39.191352 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.191416 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.191471 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:34:39.197480 23173 raft_consensus.cc:1261] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 1 FOLLOWER]: Refusing update from remote peer f8862f2d1e51437db0288f37fe021da0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:39.197475 23464 raft_consensus.cc:1261] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 1 FOLLOWER]: Refusing update from remote peer f8862f2d1e51437db0288f37fe021da0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:39.198278 23542 consensus_queue.cc:1035] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cebf4bac46a4031943d84278207955e" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 41597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:39.198488 23544 consensus_queue.cc:1035] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1950d2dd64b14836917d87b84686396d" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 43787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:39.207435 23549 mvcc.cc:205] Tried to move back new op lower bound from 7316981674785632256 to 7316981674686017536. Current Snapshot: MvccSnapshot[applied={T|T < 7316981674785632256}]
I20260810 14:34:39.214270 23011 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:39.214430 23011 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:39.216979 23011 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ac3936aff464642ad77382a9d0d44df: Sending DeleteTablet for 3 replicas of tablet 3625bcb2e9e84639987ee994d2d50ec1
I20260810 14:34:39.218032 23150 tablet_service.cc:1514] Processing DeleteTablet for tablet 3625bcb2e9e84639987ee994d2d50ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:39 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:35788
I20260810 14:34:39.218207 23299 tablet_service.cc:1514] Processing DeleteTablet for tablet 3625bcb2e9e84639987ee994d2d50ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:39 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:57410
I20260810 14:34:39.218230 23443 tablet_service.cc:1514] Processing DeleteTablet for tablet 3625bcb2e9e84639987ee994d2d50ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:39 UTC) from {username='kudu', principal='kudu/127.1.206.126@KRBTEST.COM'} at 127.0.0.1:38992
I20260810 14:34:39.218837 23559 tablet_replica.cc:330] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d: stopping tablet replica
I20260810 14:34:39.218770 23561 tablet_replica.cc:330] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: stopping tablet replica
I20260810 14:34:39.219219 23561 raft_consensus.cc:2229] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:39.219291 23559 raft_consensus.cc:2229] T 3625bcb2e9e84639987ee994d2d50ec1 P 1950d2dd64b14836917d87b84686396d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:39.219597 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 23080
I20260810 14:34:39.229454 23561 raft_consensus.cc:2258] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:39.230026 23562 tablet_replica.cc:330] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: stopping tablet replica
I20260810 14:34:39.230392 23562 raft_consensus.cc:2229] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:34:39.230786 23562 raft_consensus.cc:2258] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:39.231868 23561 ts_tablet_manager.cc:1905] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:39.232177 23562 ts_tablet_manager.cc:1905] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:39.234987 23562 ts_tablet_manager.cc:1918] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:39.235100 23562 log.cc:1196] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/3625bcb2e9e84639987ee994d2d50ec1
I20260810 14:34:39.235432 23562 ts_tablet_manager.cc:1939] T 3625bcb2e9e84639987ee994d2d50ec1 P f8862f2d1e51437db0288f37fe021da0: Deleting consensus metadata
I20260810 14:34:39.235836 23561 ts_tablet_manager.cc:1918] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:39.236006 23561 log.cc:1196] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/3625bcb2e9e84639987ee994d2d50ec1
I20260810 14:34:39.236447 23561 ts_tablet_manager.cc:1939] T 3625bcb2e9e84639987ee994d2d50ec1 P 9cebf4bac46a4031943d84278207955e: Deleting consensus metadata
I20260810 14:34:39.236953 22995 catalog_manager.cc:4841] TS f8862f2d1e51437db0288f37fe021da0 (127.1.206.66:44421): tablet 3625bcb2e9e84639987ee994d2d50ec1 (table test-table [id=6bcbda494791432a9e2fc74c4bcf409e]) successfully deleted
W20260810 14:34:39.237583 22994 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:43787 (error 108)
I20260810 14:34:39.237854 22996 catalog_manager.cc:4841] TS 9cebf4bac46a4031943d84278207955e (127.1.206.67:41597): tablet 3625bcb2e9e84639987ee994d2d50ec1 (table test-table [id=6bcbda494791432a9e2fc74c4bcf409e]) successfully deleted
I20260810 14:34:39.238550 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 23229
I20260810 14:34:39.239305 23527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.238412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:43787 (local address 127.0.0.1:35804)
0810 14:34:39.239153 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.239224 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:43787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":656}
W20260810 14:34:39.239862 22994 catalog_manager.cc:4584] TS 1950d2dd64b14836917d87b84686396d (127.1.206.65:43787): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3625bcb2e9e84639987ee994d2d50ec1: Network error: Client connection negotiation failed: client connection to 127.1.206.65:43787: connect: Connection refused (error 111)
I20260810 14:34:39.254405 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 23376
I20260810 14:34:39.266472 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 22975
2026-08-10T14:34:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2371 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T14:34:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:39Z Disabled control of system clock
I20260810 14:34:39.301195 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:37855
--webserver_interface=127.1.206.126
--webserver_port=0
--builtin_ntp_servers=127.1.206.84:44365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:37855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:34:39.420769 23567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:39.421056 23567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:39.421140 23567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:39.425271 23567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:39.425347 23567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:39.425364 23567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:39.425381 23567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:39.425397 23567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:39.430694 23567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:37855
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:37855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:39.431969 23567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:39.433475 23567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:39.442451 23577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:39.442451 23572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:39.442451 23573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:39.442698 23567 server_base.cc:1034] running on GCE node
I20260810 14:34:39.443338 23567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:39.444499 23567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:39.445693 23567 hybrid_clock.cc:648] HybridClock initialized: now 1786372479445662 us; error 51 us; skew 500 ppm
I20260810 14:34:39.451483 23567 webserver.cc:460] Webserver started at http://127.1.206.126:44241/ using document root <none> and password file <none>
I20260810 14:34:39.452175 23567 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:39.452308 23567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:39.452570 23567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:39.454914 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "5e095a65ad9445d997d48a1b1287960a"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "137d684cc71c4317650b1028e4f07267"
server_key_iv: "97a24749b147f7811f9cb55dd817c36f"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.455523 23567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "5e095a65ad9445d997d48a1b1287960a"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "137d684cc71c4317650b1028e4f07267"
server_key_iv: "97a24749b147f7811f9cb55dd817c36f"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.459601 23567 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 14:34:39.462303 23583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.463559 23567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:39.463722 23567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "5e095a65ad9445d997d48a1b1287960a"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "137d684cc71c4317650b1028e4f07267"
server_key_iv: "97a24749b147f7811f9cb55dd817c36f"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.463852 23567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:39.475970 23567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:39.476718 23567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:39.476931 23567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:39.484105 23567 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:37855
I20260810 14:34:39.484138 23644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:37855 every 8 connection(s)
I20260810 14:34:39.485141 23567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:39.488076 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 23567
I20260810 14:34:39.488232 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:39.488636 1849 external_mini_cluster.cc:1428] Setting key 39574266ed36693d4f213a02ceda584d
I20260810 14:34:39.488633 23645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:39.495626 23645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a: Bootstrap starting.
I20260810 14:34:39.498021 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.490182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.1.206.126:37855)
0810 14:34:39.490912 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.490928 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.490965 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:34:39.491610 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.491627 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.492011 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.492397 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:39.492827 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.493817 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.494713 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.495192 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.495378 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.496339 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:39.496344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:39.496356 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:39.496728 (+ 372us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:39.496786 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:39.496806 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:39.496916 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.497063 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.497327 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":172,"threads_started":1}
I20260810 14:34:39.498049 23645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:39.498864 23645 log.cc:824] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:39.501024 23645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a: No bootstrap required, opened a new log
I20260810 14:34:39.504557 23645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e095a65ad9445d997d48a1b1287960a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37855 } }
I20260810 14:34:39.504797 23645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:39.504845 23645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e095a65ad9445d997d48a1b1287960a, State: Initialized, Role: FOLLOWER
I20260810 14:34:39.505211 23645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e095a65ad9445d997d48a1b1287960a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37855 } }
I20260810 14:34:39.505323 23645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:39.505367 23645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:39.505438 23645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:39.506704 23645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e095a65ad9445d997d48a1b1287960a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37855 } }
I20260810 14:34:39.507009 23645 leader_election.cc:302] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e095a65ad9445d997d48a1b1287960a; no voters:
I20260810 14:34:39.507282 23645 leader_election.cc:288] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:39.507459 23650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:39.507721 23650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [term 1 LEADER]: Becoming Leader. State: Replica: 5e095a65ad9445d997d48a1b1287960a, State: Running, Role: LEADER
I20260810 14:34:39.508040 23650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e095a65ad9445d997d48a1b1287960a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37855 } }
I20260810 14:34:39.508633 23645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:39.509761 23652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e095a65ad9445d997d48a1b1287960a. Latest consensus state: current_term: 1 leader_uuid: "5e095a65ad9445d997d48a1b1287960a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e095a65ad9445d997d48a1b1287960a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37855 } } }
I20260810 14:34:39.509904 23652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:39.510212 23651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e095a65ad9445d997d48a1b1287960a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e095a65ad9445d997d48a1b1287960a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37855 } } }
I20260810 14:34:39.510365 23659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:39.510380 23651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:39.513574 23659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:39.519719 23659 catalog_manager.cc:1347] Generated new cluster ID: 017c549dee6842f9a351122b488f5938
I20260810 14:34:39.519806 23659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:39.547848 23659 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:39.548938 23659 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:39.556766 23659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a: Generated new TSK 0
I20260810 14:34:39.557493 23659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:39.564129 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.65:0
--local_ip_for_outbound_sockets=127.1.206.65
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37855
--builtin_ntp_servers=127.1.206.84:44365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:34:39.680403 23670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:39.680691 23670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:39.680774 23670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:39.684968 23670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:39.685040 23670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:39.685099 23670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.65
I20260810 14:34:39.689993 23670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.206.65
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.65
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:39.691260 23670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:39.692744 23670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:39.702629 23678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:39.702741 23670 server_base.cc:1034] running on GCE node
W20260810 14:34:39.702629 23676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:39.702666 23675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:39.703315 23670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:39.703992 23670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:39.705180 23670 hybrid_clock.cc:648] HybridClock initialized: now 1786372479705145 us; error 48 us; skew 500 ppm
I20260810 14:34:39.707084 23670 webserver.cc:460] Webserver started at http://127.1.206.65:40633/ using document root <none> and password file <none>
I20260810 14:34:39.707698 23670 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:39.707795 23670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:39.708039 23670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:39.710408 23670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data/instance:
uuid: "01421da1766c405981abacf0e6cf9e53"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "d21b42de98f1b40e6d30cfd78d77d53d"
server_key_iv: "621157efb5834b3ff728b06ecc7972ff"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.710994 23670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance:
uuid: "01421da1766c405981abacf0e6cf9e53"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "d21b42de98f1b40e6d30cfd78d77d53d"
server_key_iv: "621157efb5834b3ff728b06ecc7972ff"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.714915 23670 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:34:39.717533 23685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.718827 23670 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:34:39.718981 23670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/wal
uuid: "01421da1766c405981abacf0e6cf9e53"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "d21b42de98f1b40e6d30cfd78d77d53d"
server_key_iv: "621157efb5834b3ff728b06ecc7972ff"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.719110 23670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:39.736869 23670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:39.737614 23670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:39.737839 23670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:39.738469 23670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:39.739480 23670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:39.739562 23670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.739636 23670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:39.739686 23670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.748886 23670 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.65:41539
I20260810 14:34:39.748914 23805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.65:41539 every 8 connection(s)
I20260810 14:34:39.749850 23670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/data/info.pb
I20260810 14:34:39.752138 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 23670
I20260810 14:34:39.752308 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-0/wal/instance
I20260810 14:34:39.752643 1849 external_mini_cluster.cc:1428] Setting key f83168f4b2db9e24471ae5fda75dff17
I20260810 14:34:39.754822 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.66:0
--local_ip_for_outbound_sockets=127.1.206.66
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37855
--builtin_ntp_servers=127.1.206.84:44365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:34:39.759819 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.751755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.65:60345 (local address 127.1.206.126:37855)
0810 14:34:39.752010 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.752015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.753169 (+ 1154us) server_negotiation.cc:407] Connection header received
0810 14:34:39.754849 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.754852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.754908 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.754984 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:39.755956 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.756614 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.757810 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.758038 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.758152 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.759300 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:39.759304 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:39.759308 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:39.759326 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:39.759346 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:39.759360 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:39.759437 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.759600 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.759670 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260810 14:34:39.760838 23808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.752143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:37855 (local address 127.1.206.65:60345)
0810 14:34:39.752989 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.753042 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.754632 (+ 1590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.755217 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.755223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.755310 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:39.755809 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.755821 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.756766 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.756769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.757662 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.757672 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.758198 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.758203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.758379 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.759028 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:39.759030 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:39.759072 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:39.759139 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:39.759452 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:39.759469 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:39.759475 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.759601 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.759908 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":193,"threads_started":1}
I20260810 14:34:39.762158 23806 heartbeater.cc:347] Connected to a master server at 127.1.206.126:37855
I20260810 14:34:39.762427 23806 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:39.762974 23806 heartbeater.cc:511] Master 127.1.206.126:37855 requested a full tablet report, sending...
I20260810 14:34:39.764802 23607 ts_manager.cc:194] Registered new tserver with Master: 01421da1766c405981abacf0e6cf9e53 (127.1.206.65:41539)
I20260810 14:34:39.766649 23607 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.65:60345
W20260810 14:34:39.872022 23809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:39.872471 23809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:39.872565 23809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:39.876976 23809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:39.877048 23809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:39.877106 23809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.66
I20260810 14:34:39.882149 23809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.206.66
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.66
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:39.883244 23809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:39.884694 23809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:39.894621 23816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:39.894682 23809 server_base.cc:1034] running on GCE node
W20260810 14:34:39.894621 23818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:39.894616 23815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:39.895257 23809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:39.895920 23809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:39.897107 23809 hybrid_clock.cc:648] HybridClock initialized: now 1786372479897087 us; error 33 us; skew 500 ppm
I20260810 14:34:39.899081 23809 webserver.cc:460] Webserver started at http://127.1.206.66:36783/ using document root <none> and password file <none>
I20260810 14:34:39.899677 23809 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:39.899785 23809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:39.900022 23809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:39.902143 23809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data/instance:
uuid: "41f21edecde14568bc040a44c4e563fc"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "b933ddd3b2d3f8e049dfc390381df0f9"
server_key_iv: "77d2db054f67ef1a39bab306fabb28dd"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.902724 23809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance:
uuid: "41f21edecde14568bc040a44c4e563fc"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "b933ddd3b2d3f8e049dfc390381df0f9"
server_key_iv: "77d2db054f67ef1a39bab306fabb28dd"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.906476 23809 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 14:34:39.909088 23825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.910643 23809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:39.910799 23809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal
uuid: "41f21edecde14568bc040a44c4e563fc"
format_stamp: "Formatted at 2026-08-10 14:34:39 on dist-test-slave-0b58"
server_key: "b933ddd3b2d3f8e049dfc390381df0f9"
server_key_iv: "77d2db054f67ef1a39bab306fabb28dd"
server_key_version: "encryptionkey@0"
I20260810 14:34:39.910924 23809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:39.921098 23809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:39.921780 23809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:39.921981 23809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:39.922639 23809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:39.923664 23809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:39.923740 23809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.923828 23809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:39.923877 23809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:39.933187 23809 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.66:43653
I20260810 14:34:39.933211 23952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.66:43653 every 8 connection(s)
I20260810 14:34:39.934160 23809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/data/info.pb
I20260810 14:34:39.942746 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 23809
I20260810 14:34:39.942901 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal/instance
I20260810 14:34:39.943323 1849 external_mini_cluster.cc:1428] Setting key 9319f7f998f9d2ca63f5e9ba1237dad3
I20260810 14:34:39.943629 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.936095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:42069 (local address 127.1.206.126:37855)
0810 14:34:39.936240 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:39.936244 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:39.937343 (+ 1099us) server_negotiation.cc:407] Connection header received
0810 14:34:39.938748 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:39.938752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:39.938806 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:39.938890 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:39.939825 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.940435 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.941566 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.941810 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.941900 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.943080 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:39.943086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:39.943088 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:39.943106 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:39.943134 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:39.943146 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:39.943231 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:39.943395 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 14:34:39.943470 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 14:34:39.944538 23955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:39.936517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:37855 (local address 127.1.206.66:42069)
0810 14:34:39.937162 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:39.937204 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:39.938501 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:39.939065 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:39.939072 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:39.939155 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:39.939659 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.939671 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.940552 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.940555 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.941442 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:39.941451 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:39.941950 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:39.941953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:39.942093 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:39.942757 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:39.942758 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:39.942800 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:39.942889 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:39.943250 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:39.943257 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:39.943262 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:34:39.943361 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 14:34:39.943629 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":116,"threads_started":1}
I20260810 14:34:39.945631 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.206.67:0
--local_ip_for_outbound_sockets=127.1.206.67
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37855
--builtin_ntp_servers=127.1.206.84:44365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:34:39.945698 23953 heartbeater.cc:347] Connected to a master server at 127.1.206.126:37855
I20260810 14:34:39.945953 23953 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:39.946596 23953 heartbeater.cc:511] Master 127.1.206.126:37855 requested a full tablet report, sending...
I20260810 14:34:39.947849 23607 ts_manager.cc:194] Registered new tserver with Master: 41f21edecde14568bc040a44c4e563fc (127.1.206.66:43653)
I20260810 14:34:39.948706 23607 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.66:42069
W20260810 14:34:40.063689 23956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:40.063969 23956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:40.064008 23956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:40.068188 23956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:40.068297 23956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:40.068369 23956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.206.67
I20260810 14:34:40.073374 23956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.206.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.206.67
--webserver_port=0
--tserver_master_addrs=127.1.206.126:37855
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.206.67
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:40.074482 23956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:40.075845 23956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:40.086012 23961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:40.086025 23962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:40.086024 23965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:40.086424 23956 server_base.cc:1034] running on GCE node
I20260810 14:34:40.086874 23956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:40.087469 23956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:40.088660 23956 hybrid_clock.cc:648] HybridClock initialized: now 1786372480088645 us; error 33 us; skew 500 ppm
I20260810 14:34:40.090543 23956 webserver.cc:460] Webserver started at http://127.1.206.67:33795/ using document root <none> and password file <none>
I20260810 14:34:40.091154 23956 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:40.091260 23956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:40.091499 23956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:40.093694 23956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data/instance:
uuid: "5386bd11825841c5924751710f650fb6"
format_stamp: "Formatted at 2026-08-10 14:34:40 on dist-test-slave-0b58"
server_key: "96316424a943b3669053e76f0b0019ab"
server_key_iv: "161f4eb9e5ec0fd7d3add44aad7df6f9"
server_key_version: "encryptionkey@0"
I20260810 14:34:40.094295 23956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance:
uuid: "5386bd11825841c5924751710f650fb6"
format_stamp: "Formatted at 2026-08-10 14:34:40 on dist-test-slave-0b58"
server_key: "96316424a943b3669053e76f0b0019ab"
server_key_iv: "161f4eb9e5ec0fd7d3add44aad7df6f9"
server_key_version: "encryptionkey@0"
I20260810 14:34:40.098157 23956 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:40.100639 23972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:40.101862 23956 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:34:40.102017 23956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal
uuid: "5386bd11825841c5924751710f650fb6"
format_stamp: "Formatted at 2026-08-10 14:34:40 on dist-test-slave-0b58"
server_key: "96316424a943b3669053e76f0b0019ab"
server_key_iv: "161f4eb9e5ec0fd7d3add44aad7df6f9"
server_key_version: "encryptionkey@0"
I20260810 14:34:40.102124 23956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:40.119270 23956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:40.120009 23956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:40.120223 23956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:40.120911 23956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:34:40.121896 23956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:34:40.121979 23956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:40.122074 23956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:34:40.122128 23956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:40.132035 23956 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.67:38495
I20260810 14:34:40.132057 24092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.67:38495 every 8 connection(s)
I20260810 14:34:40.133095 23956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/data/info.pb
I20260810 14:34:40.133961 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 23956
I20260810 14:34:40.134091 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal/instance
I20260810 14:34:40.134466 1849 external_mini_cluster.cc:1428] Setting key bc1b4e0e8369994cba79cd45212a3381
I20260810 14:34:40.143497 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.135327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.67:56387 (local address 127.1.206.126:37855)
0810 14:34:40.135523 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.135529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.136878 (+ 1349us) server_negotiation.cc:407] Connection header received
0810 14:34:40.138504 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.138507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.138554 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.138636 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:40.139570 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.140102 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.141595 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.141831 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.141915 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.143034 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:40.143037 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:40.143039 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:40.143052 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:40.143075 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:40.143083 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:40.143143 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.143320 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.143376 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260810 14:34:40.144443 24095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.135771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:37855 (local address 127.1.206.67:56387)
0810 14:34:40.136666 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.136731 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:40.138280 (+ 1549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:40.138771 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:40.138778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:40.138869 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:34:40.139409 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.139423 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.140241 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.140245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.141460 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.141471 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.141972 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.141974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.142124 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.142768 (+ 644us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:34:40.142770 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:34:40.142811 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:34:40.142878 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:34:40.143157 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:34:40.143163 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:34:40.143168 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:34:40.143299 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 14:34:40.143535 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":125,"threads_started":1}
I20260810 14:34:40.145642 24093 heartbeater.cc:347] Connected to a master server at 127.1.206.126:37855
I20260810 14:34:40.145900 24093 heartbeater.cc:464] Registering TS with master...
I20260810 14:34:40.146486 24093 heartbeater.cc:511] Master 127.1.206.126:37855 requested a full tablet report, sending...
I20260810 14:34:40.147668 23607 ts_manager.cc:194] Registered new tserver with Master: 5386bd11825841c5924751710f650fb6 (127.1.206.67:38495)
I20260810 14:34:40.148425 23607 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.206.67:56387
I20260810 14:34:40.149304 1849 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:34:40.155225 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.151409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46932 (local address 127.1.206.126:37855)
0810 14:34:40.151576 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.151581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.151800 (+ 219us) server_negotiation.cc:407] Connection header received
0810 14:34:40.151884 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.151886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.151928 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.151996 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:40.152221 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.152796 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.153612 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.153840 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.153920 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.154777 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:40.154780 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:40.154782 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:40.154794 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:40.154816 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:40.154824 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:40.154888 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.154986 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.155038 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 14:34:40.158387 23607 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:34:40.161545 23607 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:34:40.177603 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.171001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:41539 (local address 127.0.0.1:52046)
0810 14:34:40.171423 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.171477 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:40.171614 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:40.172716 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:40.172724 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:40.172753 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:40.172883 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.172888 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.174285 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.174290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.175985 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.175996 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.176988 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.176992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.177125 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.177192 (+ 67us) client_negotiation.cc:769] Sending connection context
0810 14:34:40.177310 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 14:34:40.177436 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":219,"thread_start_us":131,"threads_started":1}
I20260810 14:34:40.177937 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.171038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38495 (local address 127.0.0.1:58144)
0810 14:34:40.172135 (+ 1097us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.172152 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:40.172237 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:40.173016 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:40.173019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:40.173036 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:40.173125 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.173132 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.174497 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.174500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.175904 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.175916 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.177107 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.177111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.177188 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.177204 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 14:34:40.177287 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:34:40.177819 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1013,"mutex_wait_us":474,"thread_start_us":158,"threads_started":1}
I20260810 14:34:40.177932 24110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.171963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58144 (local address 127.1.206.67:38495)
0810 14:34:40.172519 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.172533 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.172557 (+ 24us) server_negotiation.cc:407] Connection header received
0810 14:34:40.172668 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.172674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.172861 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.173030 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:40.173234 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.174380 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.176046 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.176972 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.177428 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.177603 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.177669 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.177771 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":152,"threads_started":1}
I20260810 14:34:40.178215 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.171733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:43653 (local address 127.0.0.1:49410)
0810 14:34:40.172905 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.172923 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:40.173002 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:40.173709 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:40.173713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:40.173732 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:40.173828 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.173833 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.175566 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.175569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.176720 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.176733 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.177831 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.177838 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.177928 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.177964 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 14:34:40.178018 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 14:34:40.178087 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"thread_start_us":117,"threads_started":1}
I20260810 14:34:40.178889 24111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.172409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49410 (local address 127.1.206.66:43653)
0810 14:34:40.173272 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.173287 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.173308 (+ 21us) server_negotiation.cc:407] Connection header received
0810 14:34:40.173380 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.173385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.173554 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.173705 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:40.173956 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.175178 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.176879 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.177656 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.178406 (+ 750us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.178587 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.178633 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.178732 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":133,"threads_started":1}
I20260810 14:34:40.177650 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.171116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52046 (local address 127.1.206.65:41539)
0810 14:34:40.172139 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.172153 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.172180 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:34:40.172261 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.172266 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.172510 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.173053 (+ 543us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:40.173198 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.174118 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.176088 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.176763 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.176945 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.177170 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.177359 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.177468 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":895,"thread_start_us":115,"threads_started":1}
I20260810 14:34:40.181273 24024 tablet_service.cc:1467] Processing CreateTablet for tablet c848438d8c9446a7a04b0f6210dac420 (DEFAULT_TABLE table=test-table [id=81f3f27695654e68a2f1a97978a24215]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:40.181749 23736 tablet_service.cc:1467] Processing CreateTablet for tablet c848438d8c9446a7a04b0f6210dac420 (DEFAULT_TABLE table=test-table [id=81f3f27695654e68a2f1a97978a24215]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:40.181656 23878 tablet_service.cc:1467] Processing CreateTablet for tablet c848438d8c9446a7a04b0f6210dac420 (DEFAULT_TABLE table=test-table [id=81f3f27695654e68a2f1a97978a24215]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:34:40.182456 24024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c848438d8c9446a7a04b0f6210dac420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:40.182695 23878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c848438d8c9446a7a04b0f6210dac420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:40.182695 23736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c848438d8c9446a7a04b0f6210dac420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:40.189281 24112 tablet_bootstrap.cc:492] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Bootstrap starting.
I20260810 14:34:40.190843 24114 tablet_bootstrap.cc:492] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: Bootstrap starting.
I20260810 14:34:40.191628 24112 tablet_bootstrap.cc:654] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:40.192468 24112 log.cc:824] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:40.192639 24113 tablet_bootstrap.cc:492] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Bootstrap starting.
I20260810 14:34:40.192863 24114 tablet_bootstrap.cc:654] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:40.193717 24114 log.cc:824] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:40.194797 24113 tablet_bootstrap.cc:654] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:40.194972 24112 tablet_bootstrap.cc:492] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: No bootstrap required, opened a new log
I20260810 14:34:40.195176 24112 ts_tablet_manager.cc:1397] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 14:34:40.195591 24113 log.cc:824] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:40.195788 24114 tablet_bootstrap.cc:492] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: No bootstrap required, opened a new log
I20260810 14:34:40.195969 24114 ts_tablet_manager.cc:1397] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 14:34:40.197399 24113 tablet_bootstrap.cc:492] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: No bootstrap required, opened a new log
I20260810 14:34:40.197598 24113 ts_tablet_manager.cc:1397] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 14:34:40.199824 24112 raft_consensus.cc:348] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.200119 24112 raft_consensus.cc:374] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:40.200177 24112 raft_consensus.cc:729] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5386bd11825841c5924751710f650fb6, State: Initialized, Role: FOLLOWER
I20260810 14:34:40.200656 24112 consensus_queue.cc:260] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.201429 24093 heartbeater.cc:503] Master 127.1.206.126:37855 was elected leader, sending a full tablet report...
I20260810 14:34:40.200213 24114 raft_consensus.cc:348] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.201618 24114 raft_consensus.cc:374] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:40.201675 24114 raft_consensus.cc:729] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01421da1766c405981abacf0e6cf9e53, State: Initialized, Role: FOLLOWER
I20260810 14:34:40.201797 24112 ts_tablet_manager.cc:1428] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 14:34:40.201627 24113 raft_consensus.cc:348] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.201858 24113 raft_consensus.cc:374] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:40.201911 24113 raft_consensus.cc:729] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41f21edecde14568bc040a44c4e563fc, State: Initialized, Role: FOLLOWER
I20260810 14:34:40.202099 24114 consensus_queue.cc:260] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.202345 24113 consensus_queue.cc:260] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.202814 23806 heartbeater.cc:503] Master 127.1.206.126:37855 was elected leader, sending a full tablet report...
I20260810 14:34:40.203102 24114 ts_tablet_manager.cc:1428] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260810 14:34:40.203269 24113 ts_tablet_manager.cc:1428] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 14:34:40.203595 23953 heartbeater.cc:503] Master 127.1.206.126:37855 was elected leader, sending a full tablet report...
W20260810 14:34:40.251073 23807 tablet.cc:2369] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:34:40.355963 24120 raft_consensus.cc:482] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:34:40.356308 24120 raft_consensus.cc:504] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.357579 24120 leader_election.cc:288] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01421da1766c405981abacf0e6cf9e53 (127.1.206.65:41539), 5386bd11825841c5924751710f650fb6 (127.1.206.67:38495)
I20260810 14:34:40.362030 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.357949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:55167 (local address 127.1.206.65:41539)
0810 14:34:40.358106 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.358112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.358131 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:34:40.358308 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.358311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.358358 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.358452 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:40.358806 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.359627 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.361019 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.361426 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.361577 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.361633 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.361813 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.361890 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 14:34:40.362030 23955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.357816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:41539 (local address 127.1.206.66:55167)
0810 14:34:40.358033 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.358051 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:40.358152 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:40.358487 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:40.358490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:40.358508 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:40.358654 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.358660 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.359772 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.359775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.360887 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.360898 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.361556 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.361560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.361671 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.361704 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 14:34:40.361795 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 14:34:40.361869 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":33}
I20260810 14:34:40.362046 24110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.358076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.206.66:50775 (local address 127.1.206.67:38495)
0810 14:34:40.358225 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.358242 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.358443 (+ 201us) server_negotiation.cc:407] Connection header received
0810 14:34:40.358602 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.358604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.358642 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.358701 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:34:40.358981 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.359679 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.361037 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.361472 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.361602 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.361649 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.361850 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.361924 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:34:40.362067 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.357943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.67:38495 (local address 127.1.206.66:50775)
0810 14:34:40.358330 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.358342 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:34:40.358477 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:34:40.358749 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:34:40.358753 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:34:40.358774 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:34:40.358877 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.358881 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.359798 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.359801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.360907 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:34:40.360917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.361598 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.361601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:34:40.361709 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.361739 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 14:34:40.361833 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 14:34:40.361903 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":40,"thread_start_us":196,"threads_started":1}
I20260810 14:34:40.362768 23757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c848438d8c9446a7a04b0f6210dac420" candidate_uuid: "41f21edecde14568bc040a44c4e563fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01421da1766c405981abacf0e6cf9e53" is_pre_election: true
I20260810 14:34:40.362782 24044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c848438d8c9446a7a04b0f6210dac420" candidate_uuid: "41f21edecde14568bc040a44c4e563fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5386bd11825841c5924751710f650fb6" is_pre_election: true
I20260810 14:34:40.363073 24044 raft_consensus.cc:2454] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f21edecde14568bc040a44c4e563fc in term 0.
I20260810 14:34:40.363083 23757 raft_consensus.cc:2454] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41f21edecde14568bc040a44c4e563fc in term 0.
I20260810 14:34:40.363610 23828 leader_election.cc:302] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41f21edecde14568bc040a44c4e563fc, 5386bd11825841c5924751710f650fb6; no voters:
I20260810 14:34:40.363925 24120 raft_consensus.cc:2781] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:34:40.364014 24120 raft_consensus.cc:482] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:34:40.364046 24120 raft_consensus.cc:3037] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:40.365149 24120 raft_consensus.cc:504] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.365571 24120 leader_election.cc:288] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [CANDIDATE]: Term 1 election: Requested vote from peers 01421da1766c405981abacf0e6cf9e53 (127.1.206.65:41539), 5386bd11825841c5924751710f650fb6 (127.1.206.67:38495)
I20260810 14:34:40.365943 23757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c848438d8c9446a7a04b0f6210dac420" candidate_uuid: "41f21edecde14568bc040a44c4e563fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01421da1766c405981abacf0e6cf9e53"
I20260810 14:34:40.366025 24044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c848438d8c9446a7a04b0f6210dac420" candidate_uuid: "41f21edecde14568bc040a44c4e563fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5386bd11825841c5924751710f650fb6"
I20260810 14:34:40.366073 23757 raft_consensus.cc:3037] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:40.366242 24044 raft_consensus.cc:3037] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:40.367268 23757 raft_consensus.cc:2454] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f21edecde14568bc040a44c4e563fc in term 1.
I20260810 14:34:40.367484 24044 raft_consensus.cc:2454] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41f21edecde14568bc040a44c4e563fc in term 1.
I20260810 14:34:40.367660 23827 leader_election.cc:302] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01421da1766c405981abacf0e6cf9e53, 41f21edecde14568bc040a44c4e563fc; no voters:
I20260810 14:34:40.367874 24120 raft_consensus.cc:2781] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:40.368095 24120 raft_consensus.cc:686] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 1 LEADER]: Becoming Leader. State: Replica: 41f21edecde14568bc040a44c4e563fc, State: Running, Role: LEADER
I20260810 14:34:40.368476 24120 consensus_queue.cc:237] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } }
I20260810 14:34:40.371609 23607 catalog_manager.cc:5495] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 41f21edecde14568bc040a44c4e563fc (127.1.206.66). New cstate: current_term: 1 leader_uuid: "41f21edecde14568bc040a44c4e563fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41f21edecde14568bc040a44c4e563fc" member_type: VOTER last_known_addr { host: "127.1.206.66" port: 43653 } health_report { overall_health: HEALTHY } } }
W20260810 14:34:40.384193 24094 tablet.cc:2369] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:34:40.415918 24111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.412062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49422 (local address 127.1.206.66:43653)
0810 14:34:40.412228 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:40.412233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:40.412249 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:34:40.412478 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:40.412481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:40.412541 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:40.412668 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:34:40.412925 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.413435 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.414354 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:40.414582 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:40.414709 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:40.415040 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:34:40.415482 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:34:40.415616 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:40.415691 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 14:34:40.415748 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 14:34:40.422406 24044 raft_consensus.cc:1261] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 1 FOLLOWER]: Refusing update from remote peer 41f21edecde14568bc040a44c4e563fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:40.422405 23757 raft_consensus.cc:1261] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 1 FOLLOWER]: Refusing update from remote peer 41f21edecde14568bc040a44c4e563fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:34:40.423193 24122 consensus_queue.cc:1035] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "01421da1766c405981abacf0e6cf9e53" member_type: VOTER last_known_addr { host: "127.1.206.65" port: 41539 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:40.423424 24120 consensus_queue.cc:1035] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5386bd11825841c5924751710f650fb6" member_type: VOTER last_known_addr { host: "127.1.206.67" port: 38495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:34:40.431866 24125 mvcc.cc:205] Tried to move back new op lower bound from 7316981679801786368 to 7316981679591976960. Current Snapshot: MvccSnapshot[applied={T|T < 7316981679801786368}]
I20260810 14:34:40.442902 23605 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:40.443117 23605 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:34:40.446064 23605 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5e095a65ad9445d997d48a1b1287960a: Sending DeleteTablet for 3 replicas of tablet c848438d8c9446a7a04b0f6210dac420
I20260810 14:34:40.447027 23736 tablet_service.cc:1514] Processing DeleteTablet for tablet c848438d8c9446a7a04b0f6210dac420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:40 UTC) from {username='slave'} at 127.0.0.1:52046
I20260810 14:34:40.447023 24024 tablet_service.cc:1514] Processing DeleteTablet for tablet c848438d8c9446a7a04b0f6210dac420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:40 UTC) from {username='slave'} at 127.0.0.1:58144
I20260810 14:34:40.447324 23878 tablet_service.cc:1514] Processing DeleteTablet for tablet c848438d8c9446a7a04b0f6210dac420 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:34:40 UTC) from {username='slave'} at 127.0.0.1:49410
I20260810 14:34:40.447897 24135 tablet_replica.cc:330] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53: stopping tablet replica
I20260810 14:34:40.448000 24137 tablet_replica.cc:330] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: stopping tablet replica
I20260810 14:34:40.448235 24136 tablet_replica.cc:330] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: stopping tablet replica
I20260810 14:34:40.448477 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 23670
I20260810 14:34:40.448494 24137 raft_consensus.cc:2229] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:34:40.448894 24135 raft_consensus.cc:2229] T c848438d8c9446a7a04b0f6210dac420 P 01421da1766c405981abacf0e6cf9e53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:40.449164 24136 raft_consensus.cc:2229] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:34:40.449541 24136 raft_consensus.cc:2258] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:40.450316 24137 raft_consensus.cc:2258] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:34:40.454061 24136 ts_tablet_manager.cc:1905] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:40.457229 24137 ts_tablet_manager.cc:1905] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:34:40.457823 24136 ts_tablet_manager.cc:1918] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:40.457937 24136 log.cc:1196] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-2/wal/wals/c848438d8c9446a7a04b0f6210dac420
I20260810 14:34:40.458277 24136 ts_tablet_manager.cc:1939] T c848438d8c9446a7a04b0f6210dac420 P 5386bd11825841c5924751710f650fb6: Deleting consensus metadata
W20260810 14:34:40.459523 23585 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.206.65:41539 (error 108)
I20260810 14:34:40.459683 23587 catalog_manager.cc:4841] TS 5386bd11825841c5924751710f650fb6 (127.1.206.67:38495): tablet c848438d8c9446a7a04b0f6210dac420 (table test-table [id=81f3f27695654e68a2f1a97978a24215]) successfully deleted
I20260810 14:34:40.460435 24137 ts_tablet_manager.cc:1918] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:34:40.460541 24137 log.cc:1196] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Deleting WAL directory at /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786372219863018-1849-0/minicluster-data/ts-1/wal/wals/c848438d8c9446a7a04b0f6210dac420
I20260810 14:34:40.460861 24137 ts_tablet_manager.cc:1939] T c848438d8c9446a7a04b0f6210dac420 P 41f21edecde14568bc040a44c4e563fc: Deleting consensus metadata
I20260810 14:34:40.461002 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 23809
I20260810 14:34:40.461050 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.460735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.65:41539 (local address 127.0.0.1:52062)
0810 14:34:40.460877 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.460955 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.65:41539: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 14:34:40.462448 23585 catalog_manager.cc:4584] TS 01421da1766c405981abacf0e6cf9e53 (127.1.206.65:41539): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c848438d8c9446a7a04b0f6210dac420: Network error: Client connection negotiation failed: client connection to 127.1.206.65:41539: connect: Connection refused (error 111)
I20260810 14:34:40.470093 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 23956
I20260810 14:34:40.471760 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:40.470277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.66:43653 (local address 127.0.0.1:49428)
0810 14:34:40.471559 (+ 1282us) negotiation.cc:107] Waiting for socket to connect
0810 14:34:40.471643 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.66:43653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1144}
I20260810 14:34:40.478075 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 23567
2026-08-10T14:34:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1209 ms)
[----------] 6 tests from EncryptionPolicyTest (11724 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:40 dist-test-slave-0b58 krb5kdc[24141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:40 dist-test-slave-0b58 krb5kdc[24141](info): set up 2 sockets
Aug 10 14:34:40 dist-test-slave-0b58 krb5kdc[24141](info): commencing operation
krb5kdc: starting...
W20260810 14:34:41.574990 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:41 dist-test-slave-0b58 krb5kdc[24141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:41.710980 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33871
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:41.829665 24156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:41.829968 24156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:41.830013 24156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:41.834156 24156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:41.834239 24156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:41.834259 24156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:41.834277 24156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:41.834293 24156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:41.840078 24156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33871
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:41.841328 24156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:41.842340 24156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:41.851558 24161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:41.851562 24162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:41.851562 24164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:41.851981 24156 server_base.cc:1034] running on GCE node
I20260810 14:34:41.852737 24156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:41.854000 24156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:41.855217 24156 hybrid_clock.cc:648] HybridClock initialized: now 1786372481855181 us; error 55 us; skew 500 ppm
Aug 10 14:34:41 dist-test-slave-0b58 krb5kdc[24141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372481, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:41.858210 24156 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:41.859256 24156 webserver.cc:460] Webserver started at http://127.0.0.1:46527/ using document root <none> and password file <none>
I20260810 14:34:41.859828 24156 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:41.859896 24156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:41.860073 24156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:41.862422 24156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "93735b3c854b4207a240ba112b271f9e"
format_stamp: "Formatted at 2026-08-10 14:34:41 on dist-test-slave-0b58"
server_key: "aca0b66f33a4beb26e5515547d4ca037"
server_key_iv: "6f4a0b17156ea58f97801e72733d764d"
server_key_version: "encryptionkey@0"
I20260810 14:34:41.862977 24156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "93735b3c854b4207a240ba112b271f9e"
format_stamp: "Formatted at 2026-08-10 14:34:41 on dist-test-slave-0b58"
server_key: "aca0b66f33a4beb26e5515547d4ca037"
server_key_iv: "6f4a0b17156ea58f97801e72733d764d"
server_key_version: "encryptionkey@0"
I20260810 14:34:41.867076 24156 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:34:41.870127 24171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:41.871493 24156 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:34:41.871623 24156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "93735b3c854b4207a240ba112b271f9e"
format_stamp: "Formatted at 2026-08-10 14:34:41 on dist-test-slave-0b58"
server_key: "aca0b66f33a4beb26e5515547d4ca037"
server_key_iv: "6f4a0b17156ea58f97801e72733d764d"
server_key_version: "encryptionkey@0"
I20260810 14:34:41.871742 24156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:41.887185 24156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:41.890805 24156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:41.891000 24156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:41.899156 24156 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33871
I20260810 14:34:41.899242 24225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33871 every 8 connection(s)
I20260810 14:34:41.900312 24156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:41.903317 24227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:41.909346 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24156
I20260810 14:34:41.909485 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:41.909796 1849 external_mini_cluster.cc:1428] Setting key 868a9c45198e9498447f3f7e57668a1d
I20260810 14:34:41.910104 24227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e: Bootstrap starting.
I20260810 14:34:41.912978 24227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:41.913796 24227 log.cc:824] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:41.915936 24227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e: No bootstrap required, opened a new log
Aug 10 14:34:41 dist-test-slave-0b58 krb5kdc[24141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:34:41.920092 24227 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93735b3c854b4207a240ba112b271f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33871 } }
I20260810 14:34:41.920429 24227 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:41.920517 24227 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93735b3c854b4207a240ba112b271f9e, State: Initialized, Role: FOLLOWER
I20260810 14:34:41.920984 24227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93735b3c854b4207a240ba112b271f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33871 } }
I20260810 14:34:41.921139 24227 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:41.921217 24227 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:41.921360 24227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:41.922564 24227 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93735b3c854b4207a240ba112b271f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33871 } }
I20260810 14:34:41.923027 24227 leader_election.cc:302] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93735b3c854b4207a240ba112b271f9e; no voters:
I20260810 14:34:41.923488 24227 leader_election.cc:288] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:41.923595 24233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:41.923907 24233 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [term 1 LEADER]: Becoming Leader. State: Replica: 93735b3c854b4207a240ba112b271f9e, State: Running, Role: LEADER
I20260810 14:34:41.924237 24233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93735b3c854b4207a240ba112b271f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33871 } }
I20260810 14:34:41.925096 24227 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:41.925673 24233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93735b3c854b4207a240ba112b271f9e. Latest consensus state: current_term: 1 leader_uuid: "93735b3c854b4207a240ba112b271f9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93735b3c854b4207a240ba112b271f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33871 } } }
I20260810 14:34:41.925813 24233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:41.926225 24238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:41.927045 24231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:41.911283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57287 (local address 127.0.0.1:33871)
0810 14:34:41.911854 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:41.911870 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:41.911909 (+ 39us) server_negotiation.cc:407] Connection header received
0810 14:34:41.912709 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:41.912736 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:41.913132 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:41.913528 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:41.914432 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:41.915474 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:41.916560 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:41.917088 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:41.917272 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:41.920235 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:41.920241 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:41.920304 (+ 63us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:41.920342 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:41.922524 (+ 2182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:41.923438 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:41.923449 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:41.923458 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:41.923682 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:41.924158 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:41.924161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:41.924163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:41.924745 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:41.924997 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:41.925724 (+ 727us) server_negotiation.cc:299] Negotiation successful
0810 14:34:41.925988 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":170,"threads_started":1}
I20260810 14:34:41.928786 24234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93735b3c854b4207a240ba112b271f9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93735b3c854b4207a240ba112b271f9e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33871 } } }
I20260810 14:34:41.928905 24234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:41.930038 24238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:41.930693 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:41.938813 24238 catalog_manager.cc:1347] Generated new cluster ID: bbf7d34c170c41e7be20aca664d09b35
I20260810 14:34:41.938907 24238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:41.943364 24231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:41.932913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51449 (local address 127.0.0.1:33871)
0810 14:34:41.933046 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:41.933051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:41.933395 (+ 344us) server_negotiation.cc:407] Connection header received
0810 14:34:41.933545 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:41.933549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:41.933604 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:41.933701 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:41.934587 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:41.935459 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:41.936709 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:41.937064 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:41.937142 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:41.939195 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:41.939199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:41.939202 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:41.939235 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:41.941194 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:41.941880 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:41.941884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:41.941887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:41.941991 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:41.942364 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:41.942368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:41.942369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:41.942606 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:41.942760 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:41.943060 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 14:34:41.943185 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 14:34:41.951814 24238 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:41.952978 24238 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:41.963194 24238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93735b3c854b4207a240ba112b271f9e: Generated new TSK 0
I20260810 14:34:41.964046 24238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:41.970134 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24156
W20260810 14:34:41.977932 24139 connection.cc:535] client connection to 127.0.0.1:33871 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33871): Connection reset by peer (error 104)
2026-08-10T14:34:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1490 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:42 dist-test-slave-0b58 krb5kdc[24261](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:42 dist-test-slave-0b58 krb5kdc[24261](info): set up 2 sockets
Aug 10 14:34:42 dist-test-slave-0b58 krb5kdc[24261](info): commencing operation
krb5kdc: starting...
W20260810 14:34:43.071802 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:43 dist-test-slave-0b58 krb5kdc[24261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:43.199692 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38775
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:43.312109 24274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:43.312448 24274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:43.312527 24274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:43.316500 24274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:43.316563 24274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:43.316583 24274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:43.316601 24274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:43.316617 24274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:43.321971 24274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:43.323061 24274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:43.324122 24274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:34:43.333271 24274 server_base.cc:1034] running on GCE node
W20260810 14:34:43.333221 24280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:43.333307 24279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:43.333441 24282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:43.334295 24274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:43.335469 24274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:43.336684 24274 hybrid_clock.cc:648] HybridClock initialized: now 1786372483336658 us; error 38 us; skew 500 ppm
Aug 10 14:34:43 dist-test-slave-0b58 krb5kdc[24261](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372483, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:43.339926 24274 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:43.341030 24274 webserver.cc:460] Webserver started at http://127.0.0.1:42215/ using document root <none> and password file <none>
I20260810 14:34:43.341660 24274 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:43.341727 24274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:43.341971 24274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:43.344151 24274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "e8c85a586e35452cb5539e2ccc126320"
format_stamp: "Formatted at 2026-08-10 14:34:43 on dist-test-slave-0b58"
server_key: "01b386042b64d0fe06a9c3a3d80457a1"
server_key_iv: "122dc3bba9ef8b1b453676ed04b41027"
server_key_version: "encryptionkey@0"
I20260810 14:34:43.344818 24274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "e8c85a586e35452cb5539e2ccc126320"
format_stamp: "Formatted at 2026-08-10 14:34:43 on dist-test-slave-0b58"
server_key: "01b386042b64d0fe06a9c3a3d80457a1"
server_key_iv: "122dc3bba9ef8b1b453676ed04b41027"
server_key_version: "encryptionkey@0"
I20260810 14:34:43.348805 24274 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:34:43.351366 24290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:43.352828 24274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:43.353017 24274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "e8c85a586e35452cb5539e2ccc126320"
format_stamp: "Formatted at 2026-08-10 14:34:43 on dist-test-slave-0b58"
server_key: "01b386042b64d0fe06a9c3a3d80457a1"
server_key_iv: "122dc3bba9ef8b1b453676ed04b41027"
server_key_version: "encryptionkey@0"
I20260810 14:34:43.353171 24274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:43.368187 24274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:43.371351 24274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:43.371519 24274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:43.379199 24274 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38775
I20260810 14:34:43.379225 24344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38775 every 8 connection(s)
I20260810 14:34:43.380155 24274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:43.382854 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:43.386967 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24274
I20260810 14:34:43.387132 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:43.387429 1849 external_mini_cluster.cc:1428] Setting key 2b99ac2e014efad42c83e989f22e7d8b
I20260810 14:34:43.389052 24345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320: Bootstrap starting.
I20260810 14:34:43.392124 24345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:43.392972 24345 log.cc:824] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:43.395116 24345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320: No bootstrap required, opened a new log
I20260810 14:34:43.397549 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:43.389019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46385 (local address 127.0.0.1:38775)
0810 14:34:43.389630 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:43.389653 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:43.389729 (+ 76us) server_negotiation.cc:407] Connection header received
0810 14:34:43.390881 (+ 1152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:43.390911 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:43.391331 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:43.391628 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:43.392052 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:43.393200 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:43.394323 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:43.394815 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:43.394941 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:43.395844 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:43.395849 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:43.395861 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:43.396239 (+ 378us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:43.396351 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:43.396378 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:43.396483 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:43.396680 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 14:34:43.396830 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":144,"threads_started":1}
I20260810 14:34:43.399035 24345 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c85a586e35452cb5539e2ccc126320" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38775 } }
I20260810 14:34:43.399284 24345 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:43.399377 24345 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8c85a586e35452cb5539e2ccc126320, State: Initialized, Role: FOLLOWER
I20260810 14:34:43.399866 24345 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c85a586e35452cb5539e2ccc126320" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38775 } }
I20260810 14:34:43.400045 24345 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:43.400113 24345 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:43.400220 24345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:43.400432 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:43.401194 24345 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c85a586e35452cb5539e2ccc126320" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38775 } }
I20260810 14:34:43.401528 24345 leader_election.cc:302] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8c85a586e35452cb5539e2ccc126320; no voters:
I20260810 14:34:43.401893 24345 leader_election.cc:288] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:43.401965 24357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:43.402200 24357 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [term 1 LEADER]: Becoming Leader. State: Replica: e8c85a586e35452cb5539e2ccc126320, State: Running, Role: LEADER
I20260810 14:34:43.402606 24357 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c85a586e35452cb5539e2ccc126320" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38775 } }
I20260810 14:34:43.403206 24345 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:43.403923 24357 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8c85a586e35452cb5539e2ccc126320. Latest consensus state: current_term: 1 leader_uuid: "e8c85a586e35452cb5539e2ccc126320" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c85a586e35452cb5539e2ccc126320" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38775 } } }
I20260810 14:34:43.404335 24357 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:43.404836 24359 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8c85a586e35452cb5539e2ccc126320" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c85a586e35452cb5539e2ccc126320" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38775 } } }
I20260810 14:34:43.405210 24359 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:43.407797 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:43.402824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39449 (local address 127.0.0.1:38775)
0810 14:34:43.402927 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:43.402931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:43.402946 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:34:43.403053 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:43.403056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:43.403101 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:43.403149 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:43.403575 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:43.404433 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:43.406010 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:43.406262 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:43.406342 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:43.407297 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:43.407301 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:43.407303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:43.407316 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:43.407344 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:43.407357 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:43.407445 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:43.407627 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 14:34:43.407665 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 14:34:43.408720 24374 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:34:43.408852 24374 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:34:43.408927 24373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:43.409648 24373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:43.415091 24373 catalog_manager.cc:1347] Generated new cluster ID: 659e2bbe60ff4f8bb23ffc146246448f
I20260810 14:34:43.415177 24373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:43.423766 24373 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:43.424898 24373 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:43.447593 24373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8c85a586e35452cb5539e2ccc126320: Generated new TSK 0
I20260810 14:34:43.448438 24373 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:43.458554 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24274
W20260810 14:34:43.466182 24259 connection.cc:535] client connection to 127.0.0.1:38775 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38775): Connection reset by peer (error 104)
2026-08-10T14:34:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1488 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:43 dist-test-slave-0b58 krb5kdc[24381](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:43 dist-test-slave-0b58 krb5kdc[24381](info): set up 2 sockets
Aug 10 14:34:43 dist-test-slave-0b58 krb5kdc[24381](info): commencing operation
krb5kdc: starting...
W20260810 14:34:44.548375 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:44 dist-test-slave-0b58 krb5kdc[24381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:44.678751 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44083
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:44.792145 24394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:44.792536 24394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:44.792636 24394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:44.796868 24394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:44.796983 24394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:44.797026 24394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:44.797067 24394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:44.797143 24394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:44.802778 24394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44083
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:44.803992 24394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:44.805133 24394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:44.814062 24399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:44.814168 24403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:44.814062 24401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:44.814504 24394 server_base.cc:1034] running on GCE node
I20260810 14:34:44.815184 24394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:44.816434 24394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:44.817627 24394 hybrid_clock.cc:648] HybridClock initialized: now 1786372484817603 us; error 36 us; skew 500 ppm
Aug 10 14:34:44 dist-test-slave-0b58 krb5kdc[24381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372484, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:44.826318 24394 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:44.827425 24394 webserver.cc:460] Webserver started at http://127.0.0.1:41269/ using document root <none> and password file <none>
I20260810 14:34:44.828022 24394 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:44.828089 24394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:44.828428 24394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:44.830741 24394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "67d08fb4e3ee4f32bbd5335b01772ecd"
format_stamp: "Formatted at 2026-08-10 14:34:44 on dist-test-slave-0b58"
server_key: "cbca67b2c9b065b71807486198625706"
server_key_iv: "e34cd53d54e9bc9069f4324daa693f88"
server_key_version: "encryptionkey@0"
I20260810 14:34:44.831449 24394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "67d08fb4e3ee4f32bbd5335b01772ecd"
format_stamp: "Formatted at 2026-08-10 14:34:44 on dist-test-slave-0b58"
server_key: "cbca67b2c9b065b71807486198625706"
server_key_iv: "e34cd53d54e9bc9069f4324daa693f88"
server_key_version: "encryptionkey@0"
I20260810 14:34:44.835433 24394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:34:44.837980 24410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:44.839247 24394 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:34:44.839412 24394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "67d08fb4e3ee4f32bbd5335b01772ecd"
format_stamp: "Formatted at 2026-08-10 14:34:44 on dist-test-slave-0b58"
server_key: "cbca67b2c9b065b71807486198625706"
server_key_iv: "e34cd53d54e9bc9069f4324daa693f88"
server_key_version: "encryptionkey@0"
I20260810 14:34:44.839541 24394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:44.844451 24394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:44.847564 24394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:44.847786 24394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:44.855388 24394 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44083
I20260810 14:34:44.855417 24465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44083 every 8 connection(s)
I20260810 14:34:44.856410 24394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:44.859290 24466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:44.865469 24466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd: Bootstrap starting.
I20260810 14:34:44.866386 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24394
I20260810 14:34:44.866557 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:44.866920 1849 external_mini_cluster.cc:1428] Setting key e1e04d98e39a4f9d322d624bb2487d2c
I20260810 14:34:44.869139 24466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:44.870048 24466 log.cc:824] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:44.872613 24466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd: No bootstrap required, opened a new log
I20260810 14:34:44.873088 24469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:44.868496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44145 (local address 127.0.0.1:44083)
0810 14:34:44.869009 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:44.869027 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:44.869065 (+ 38us) server_negotiation.cc:407] Connection header received
0810 14:34:44.869907 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:44.869928 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:44.870319 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:44.870705 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:44.871572 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:44.871577 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:44.871592 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:44.871605 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:44.871675 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:44.871705 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:44.871832 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:44.871937 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 14:34:44.872096 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":145,"threads_started":1}
I20260810 14:34:44.876366 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:44.877197 24466 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44083 } }
I20260810 14:34:44.877434 24466 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:44.877493 24466 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d08fb4e3ee4f32bbd5335b01772ecd, State: Initialized, Role: FOLLOWER
I20260810 14:34:44.877975 24466 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44083 } }
I20260810 14:34:44.878115 24466 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:44.878206 24466 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:44.878328 24466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:44.879650 24466 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44083 } }
I20260810 14:34:44.880023 24466 leader_election.cc:302] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67d08fb4e3ee4f32bbd5335b01772ecd; no voters:
I20260810 14:34:44.880452 24466 leader_election.cc:288] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:44.880577 24476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:44.880836 24469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:44.878834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43273 (local address 127.0.0.1:44083)
0810 14:34:44.878974 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:44.878979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:44.879154 (+ 175us) server_negotiation.cc:407] Connection header received
0810 14:34:44.879287 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:44.879293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:44.879336 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:44.879452 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:44.880346 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:44.880351 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:44.880355 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:44.880372 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:44.880405 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:44.880419 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:44.880518 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:44.880650 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 14:34:44.880690 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:34:44.880909 24476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [term 1 LEADER]: Becoming Leader. State: Replica: 67d08fb4e3ee4f32bbd5335b01772ecd, State: Running, Role: LEADER
I20260810 14:34:44.881392 24476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44083 } }
I20260810 14:34:44.881919 24466 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:44.882752 24477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67d08fb4e3ee4f32bbd5335b01772ecd. Latest consensus state: current_term: 1 leader_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44083 } } }
I20260810 14:34:44.882959 24477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:44.883226 24478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d08fb4e3ee4f32bbd5335b01772ecd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44083 } } }
I20260810 14:34:44.883337 24478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:44.883440 24485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:44.886970 24485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:44.893151 24485 catalog_manager.cc:1347] Generated new cluster ID: e6676af6d40d48f895fddb508f714806
I20260810 14:34:44.893236 24485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:44.928750 24485 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:44.929200 24485 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:44.938051 24485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67d08fb4e3ee4f32bbd5335b01772ecd: Generated new TSK 0
I20260810 14:34:44.938817 24485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:44.951556 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24394
2026-08-10T14:34:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:45 dist-test-slave-0b58 krb5kdc[24497](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:45 dist-test-slave-0b58 krb5kdc[24497](info): set up 2 sockets
Aug 10 14:34:45 dist-test-slave-0b58 krb5kdc[24497](info): commencing operation
krb5kdc: starting...
W20260810 14:34:46.039741 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:46 dist-test-slave-0b58 krb5kdc[24497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:46.172147 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37753
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:46.289211 24512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:46.289534 24512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:46.289616 24512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:46.293753 24512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:46.293851 24512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:46.293890 24512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:46.293948 24512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:46.293990 24512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:46.299389 24512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:46.300629 24512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:46.301674 24512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:46.310559 24521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:46.310564 24519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:46.310557 24518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:46.311048 24512 server_base.cc:1034] running on GCE node
I20260810 14:34:46.311640 24512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:46.312885 24512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:46.314083 24512 hybrid_clock.cc:648] HybridClock initialized: now 1786372486314068 us; error 29 us; skew 500 ppm
Aug 10 14:34:46 dist-test-slave-0b58 krb5kdc[24497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372486, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:46.316955 24512 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:46.317873 24512 webserver.cc:460] Webserver started at http://127.0.0.1:45299/ using document root <none> and password file <none>
I20260810 14:34:46.318405 24512 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:46.318466 24512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:46.318697 24512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:46.320866 24512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "abe9b5b6f666470faccce20588dd78a7"
format_stamp: "Formatted at 2026-08-10 14:34:46 on dist-test-slave-0b58"
server_key: "1c67af7539ad05ee0e196f21bf99caa3"
server_key_iv: "a4a20e7c23f496990a1ff7ced42d570c"
server_key_version: "encryptionkey@0"
I20260810 14:34:46.321415 24512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "abe9b5b6f666470faccce20588dd78a7"
format_stamp: "Formatted at 2026-08-10 14:34:46 on dist-test-slave-0b58"
server_key: "1c67af7539ad05ee0e196f21bf99caa3"
server_key_iv: "a4a20e7c23f496990a1ff7ced42d570c"
server_key_version: "encryptionkey@0"
I20260810 14:34:46.325222 24512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:34:46.327679 24528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:46.329021 24512 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 14:34:46.329154 24512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "abe9b5b6f666470faccce20588dd78a7"
format_stamp: "Formatted at 2026-08-10 14:34:46 on dist-test-slave-0b58"
server_key: "1c67af7539ad05ee0e196f21bf99caa3"
server_key_iv: "a4a20e7c23f496990a1ff7ced42d570c"
server_key_version: "encryptionkey@0"
I20260810 14:34:46.329269 24512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:46.345830 24512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:46.349632 24512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:46.349864 24512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:46.357354 24512 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37753
I20260810 14:34:46.357391 24583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37753 every 8 connection(s)
I20260810 14:34:46.358309 24512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:46.359449 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24512
I20260810 14:34:46.359591 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:46.359881 1849 external_mini_cluster.cc:1428] Setting key 364d855f13872fc42433450b95b3e089
I20260810 14:34:46.361306 24584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:46.368117 24584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7: Bootstrap starting.
Aug 10 14:34:46 dist-test-slave-0b58 krb5kdc[24497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:34:46.370472 24584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:46.371446 24584 log.cc:824] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:46.373889 24584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7: No bootstrap required, opened a new log
I20260810 14:34:46.375276 24587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:46.361348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38663 (local address 127.0.0.1:37753)
0810 14:34:46.361803 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:46.361823 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:46.361865 (+ 42us) server_negotiation.cc:407] Connection header received
0810 14:34:46.362742 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:46.362765 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:46.363197 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:46.363558 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:46.364294 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:46.365800 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:46.366645 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:46.367390 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:46.367562 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:46.370031 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:46.370037 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:46.370051 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:46.370083 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:46.372117 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:46.372705 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:46.372710 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:46.372716 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:46.372852 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:46.373121 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:46.373124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:46.373125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:46.373642 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:46.373829 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:46.374043 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 14:34:46.374364 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":137,"threads_started":1}
I20260810 14:34:46.378285 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:46.378152 24584 raft_consensus.cc:348] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe9b5b6f666470faccce20588dd78a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37753 } }
I20260810 14:34:46.378427 24584 raft_consensus.cc:374] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:46.378489 24584 raft_consensus.cc:729] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe9b5b6f666470faccce20588dd78a7, State: Initialized, Role: FOLLOWER
I20260810 14:34:46.378952 24584 consensus_queue.cc:260] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe9b5b6f666470faccce20588dd78a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37753 } }
I20260810 14:34:46.379103 24584 raft_consensus.cc:388] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:46.379184 24584 raft_consensus.cc:482] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:46.379285 24584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:46.380486 24584 raft_consensus.cc:504] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe9b5b6f666470faccce20588dd78a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37753 } }
I20260810 14:34:46.380874 24584 leader_election.cc:302] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abe9b5b6f666470faccce20588dd78a7; no voters:
I20260810 14:34:46.381238 24584 leader_election.cc:288] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:46.381366 24594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:46.381596 24594 raft_consensus.cc:686] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [term 1 LEADER]: Becoming Leader. State: Replica: abe9b5b6f666470faccce20588dd78a7, State: Running, Role: LEADER
I20260810 14:34:46.381923 24594 consensus_queue.cc:237] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe9b5b6f666470faccce20588dd78a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37753 } }
I20260810 14:34:46.382553 24584 sys_catalog.cc:564] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:46.383196 24594 sys_catalog.cc:455] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abe9b5b6f666470faccce20588dd78a7. Latest consensus state: current_term: 1 leader_uuid: "abe9b5b6f666470faccce20588dd78a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe9b5b6f666470faccce20588dd78a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37753 } } }
I20260810 14:34:46.383334 24594 sys_catalog.cc:458] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:46.383785 24596 sys_catalog.cc:455] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abe9b5b6f666470faccce20588dd78a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abe9b5b6f666470faccce20588dd78a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37753 } } }
I20260810 14:34:46.383893 24596 sys_catalog.cc:458] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7 [sys.catalog]: This master's current role is: LEADER
W20260810 14:34:46.388020 24610 catalog_manager.cc:1558] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:34:46.388113 24610 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:34:46.388187 24602 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:46.389111 24602 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:46.389889 24587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:46.380656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37371 (local address 127.0.0.1:37753)
0810 14:34:46.380767 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:46.380771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:46.380919 (+ 148us) server_negotiation.cc:407] Connection header received
0810 14:34:46.381036 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:46.381040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:46.381086 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:46.381162 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:46.382028 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:46.382823 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:46.384027 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:46.384392 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:46.384515 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:46.386254 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:46.386258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:46.386261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:46.386281 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:46.387945 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:46.388488 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:46.388492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:46.388494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:46.388582 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:46.388910 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:46.388914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:46.388915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:46.389134 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:46.389259 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:46.389618 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 14:34:46.389739 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 14:34:46.394774 24602 catalog_manager.cc:1347] Generated new cluster ID: d8f21303110146788228bef68b50bab8
I20260810 14:34:46.394841 24602 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:46.426046 24602 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:46.427057 24602 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:46.453158 24602 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abe9b5b6f666470faccce20588dd78a7: Generated new TSK 0
I20260810 14:34:46.454083 24602 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:46.457758 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24512
2026-08-10T14:34:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1507 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:46 dist-test-slave-0b58 krb5kdc[24617](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:46 dist-test-slave-0b58 krb5kdc[24617](info): set up 2 sockets
Aug 10 14:34:46 dist-test-slave-0b58 krb5kdc[24617](info): commencing operation
krb5kdc: starting...
W20260810 14:34:47.535390 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:47 dist-test-slave-0b58 krb5kdc[24617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:47.666682 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40443
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40443
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:47.783383 24630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:47.783651 24630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:47.783702 24630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:47.787691 24630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:47.787753 24630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:47.787773 24630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:47.787789 24630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:47.787804 24630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:47.793159 24630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:47.794255 24630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:47.795230 24630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:47.803704 24640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:47.803704 24637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:47.803732 24636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:47.804291 24630 server_base.cc:1034] running on GCE node
I20260810 14:34:47.804807 24630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:47.805902 24630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:47.807066 24630 hybrid_clock.cc:648] HybridClock initialized: now 1786372487807043 us; error 45 us; skew 500 ppm
Aug 10 14:34:47 dist-test-slave-0b58 krb5kdc[24617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372487, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:47.810029 24630 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:47.810992 24630 webserver.cc:460] Webserver started at http://127.0.0.1:43021/ using document root <none> and password file <none>
I20260810 14:34:47.811563 24630 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:47.811654 24630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:47.811892 24630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:47.814035 24630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "637450f2f0254185a472f57b75a70559"
format_stamp: "Formatted at 2026-08-10 14:34:47 on dist-test-slave-0b58"
server_key: "5459552356f63d74a6a9a30dd98c960f"
server_key_iv: "1423af92b4ae99da0b2b1d7a98a0a9c8"
server_key_version: "encryptionkey@0"
I20260810 14:34:47.814671 24630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "637450f2f0254185a472f57b75a70559"
format_stamp: "Formatted at 2026-08-10 14:34:47 on dist-test-slave-0b58"
server_key: "5459552356f63d74a6a9a30dd98c960f"
server_key_iv: "1423af92b4ae99da0b2b1d7a98a0a9c8"
server_key_version: "encryptionkey@0"
I20260810 14:34:47.818550 24630 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:47.821184 24649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:47.822427 24630 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:34:47.822594 24630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "637450f2f0254185a472f57b75a70559"
format_stamp: "Formatted at 2026-08-10 14:34:47 on dist-test-slave-0b58"
server_key: "5459552356f63d74a6a9a30dd98c960f"
server_key_iv: "1423af92b4ae99da0b2b1d7a98a0a9c8"
server_key_version: "encryptionkey@0"
I20260810 14:34:47.822731 24630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:47.854339 24630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:47.857893 24630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:47.858119 24630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:47.865815 24630 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40443
I20260810 14:34:47.865833 24703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40443 every 8 connection(s)
I20260810 14:34:47.866803 24630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:47.869585 24704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:47.874228 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24630
I20260810 14:34:47.874397 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:47.874704 1849 external_mini_cluster.cc:1428] Setting key 7e737f097cdc175e8c838927f3a6bc25
I20260810 14:34:47.875655 24704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559: Bootstrap starting.
I20260810 14:34:47.878031 24704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:47.878777 24704 log.cc:824] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:47.880695 24704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559: No bootstrap required, opened a new log
I20260810 14:34:47.883703 24707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:47.876195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46835 (local address 127.0.0.1:40443)
0810 14:34:47.876654 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:47.876668 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:47.876704 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:34:47.877366 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:47.877382 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:47.877724 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:47.878061 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:47.878483 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:47.879514 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:47.880495 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:47.881032 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:47.881212 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:47.882088 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:47.882093 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:47.882106 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:47.882486 (+ 380us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:47.882539 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:47.882562 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:47.882677 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:47.882793 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 14:34:47.883007 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":136,"threads_started":1}
I20260810 14:34:47.884366 24704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637450f2f0254185a472f57b75a70559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40443 } }
I20260810 14:34:47.884618 24704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:47.884676 24704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 637450f2f0254185a472f57b75a70559, State: Initialized, Role: FOLLOWER
I20260810 14:34:47.885114 24704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637450f2f0254185a472f57b75a70559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40443 } }
I20260810 14:34:47.885282 24704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:47.885365 24704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:47.885488 24704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:47.886684 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:47.886677 24704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637450f2f0254185a472f57b75a70559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40443 } }
I20260810 14:34:47.887015 24704 leader_election.cc:302] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 637450f2f0254185a472f57b75a70559; no voters:
I20260810 14:34:47.887362 24704 leader_election.cc:288] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:47.887475 24709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:47.887709 24709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [term 1 LEADER]: Becoming Leader. State: Replica: 637450f2f0254185a472f57b75a70559, State: Running, Role: LEADER
I20260810 14:34:47.888016 24709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637450f2f0254185a472f57b75a70559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40443 } }
I20260810 14:34:47.888702 24704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:47.889828 24710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "637450f2f0254185a472f57b75a70559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637450f2f0254185a472f57b75a70559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40443 } } }
I20260810 14:34:47.889828 24711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 637450f2f0254185a472f57b75a70559. Latest consensus state: current_term: 1 leader_uuid: "637450f2f0254185a472f57b75a70559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "637450f2f0254185a472f57b75a70559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40443 } } }
I20260810 14:34:47.889992 24710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:47.889992 24711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559 [sys.catalog]: This master's current role is: LEADER
W20260810 14:34:47.893906 24731 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:34:47.893997 24731 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:34:47.894073 24723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:47.894901 24723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:47.895237 24707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:47.888960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44655 (local address 127.0.0.1:40443)
0810 14:34:47.889091 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:47.889095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:47.890438 (+ 1343us) server_negotiation.cc:407] Connection header received
0810 14:34:47.890566 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:47.890569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:47.890623 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:47.890700 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:47.891670 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:47.892183 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:47.893365 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:47.893694 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:47.893817 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:47.894703 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:47.894707 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:47.894709 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:47.894731 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:47.894760 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:47.894774 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:47.894858 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:47.895058 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 14:34:47.895116 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:34:47.900202 24723 catalog_manager.cc:1347] Generated new cluster ID: 11a96a64d97240b285a333c2641d676a
I20260810 14:34:47.900295 24723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:47.913158 24723 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:47.914207 24723 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:47.919659 24723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 637450f2f0254185a472f57b75a70559: Generated new TSK 0
I20260810 14:34:47.920432 24723 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:47.924619 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24630
2026-08-10T14:34:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1464 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:47 dist-test-slave-0b58 krb5kdc[24737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:47 dist-test-slave-0b58 krb5kdc[24737](info): set up 2 sockets
Aug 10 14:34:47 dist-test-slave-0b58 krb5kdc[24737](info): commencing operation
krb5kdc: starting...
W20260810 14:34:49.027051 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:49 dist-test-slave-0b58 krb5kdc[24737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:49.155792 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45003
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:49.268038 24752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:49.268384 24752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:49.268481 24752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:49.272699 24752 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:49.272789 24752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:49.272828 24752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:49.272886 24752 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:49.272926 24752 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:49.278194 24752 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:49.279289 24752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:49.280365 24752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:49.288552 24758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:49.288566 24759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:49.288638 24752 server_base.cc:1034] running on GCE node
W20260810 14:34:49.288566 24761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:49.289372 24752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:49.290438 24752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:49.291630 24752 hybrid_clock.cc:648] HybridClock initialized: now 1786372489291610 us; error 32 us; skew 500 ppm
Aug 10 14:34:49 dist-test-slave-0b58 krb5kdc[24737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372489, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:49.294364 24752 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:49.295272 24752 webserver.cc:460] Webserver started at http://127.0.0.1:42069/ using document root <none> and password file <none>
I20260810 14:34:49.295871 24752 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:49.295971 24752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:49.296214 24752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:49.298270 24752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "33f59e6cc94f46cb996f71e9dd661701"
format_stamp: "Formatted at 2026-08-10 14:34:49 on dist-test-slave-0b58"
server_key: "b59a70f2a6f23f640112c9111702c014"
server_key_iv: "b7147a4acdb6c0692de7724fabeabe8f"
server_key_version: "encryptionkey@0"
I20260810 14:34:49.298846 24752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "33f59e6cc94f46cb996f71e9dd661701"
format_stamp: "Formatted at 2026-08-10 14:34:49 on dist-test-slave-0b58"
server_key: "b59a70f2a6f23f640112c9111702c014"
server_key_iv: "b7147a4acdb6c0692de7724fabeabe8f"
server_key_version: "encryptionkey@0"
I20260810 14:34:49.302511 24752 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 14:34:49.304972 24770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:49.306226 24752 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:49.306368 24752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "33f59e6cc94f46cb996f71e9dd661701"
format_stamp: "Formatted at 2026-08-10 14:34:49 on dist-test-slave-0b58"
server_key: "b59a70f2a6f23f640112c9111702c014"
server_key_iv: "b7147a4acdb6c0692de7724fabeabe8f"
server_key_version: "encryptionkey@0"
I20260810 14:34:49.306484 24752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:49.311105 24752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:49.313966 24752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:49.314167 24752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:49.321249 24752 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45003
I20260810 14:34:49.321254 24826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45003 every 8 connection(s)
I20260810 14:34:49.322151 24752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:49.322538 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24752
I20260810 14:34:49.322693 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:49.323009 1849 external_mini_cluster.cc:1428] Setting key 9fb05ad88cd8154e2b38e33b3d28ea3e
I20260810 14:34:49.325259 24827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:49.328195 24830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:49.324448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46621 (local address 127.0.0.1:45003)
0810 14:34:49.324892 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:49.324906 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:49.324942 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:34:49.325634 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:49.325651 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:49.325918 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:49.326296 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:49.327071 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:49.327075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:49.327086 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:49.327097 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:49.327153 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:49.327173 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:49.327332 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:49.327402 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 14:34:49.327547 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":154,"threads_started":1}
I20260810 14:34:49.331066 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:49.331640 24827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701: Bootstrap starting.
I20260810 14:34:49.334141 24827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:49.335024 24830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:49.333248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41159 (local address 127.0.0.1:45003)
0810 14:34:49.333380 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:49.333385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:49.333589 (+ 204us) server_negotiation.cc:407] Connection header received
0810 14:34:49.333710 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:49.333712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:49.333753 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:49.333815 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:49.334618 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:49.334620 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:49.334622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:49.334632 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:49.334657 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:49.334667 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:49.334747 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:49.334849 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 14:34:49.334881 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 14:34:49.335137 24827 log.cc:824] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:49.337118 24827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701: No bootstrap required, opened a new log
I20260810 14:34:49.340603 24827 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f59e6cc94f46cb996f71e9dd661701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45003 } }
I20260810 14:34:49.340866 24827 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:49.340955 24827 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f59e6cc94f46cb996f71e9dd661701, State: Initialized, Role: FOLLOWER
I20260810 14:34:49.341413 24827 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f59e6cc94f46cb996f71e9dd661701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45003 } }
I20260810 14:34:49.341566 24827 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:49.341656 24827 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:49.341773 24827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:49.342716 24827 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f59e6cc94f46cb996f71e9dd661701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45003 } }
I20260810 14:34:49.343060 24827 leader_election.cc:302] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33f59e6cc94f46cb996f71e9dd661701; no voters:
I20260810 14:34:49.343371 24827 leader_election.cc:288] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:49.343494 24837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:49.343757 24837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [term 1 LEADER]: Becoming Leader. State: Replica: 33f59e6cc94f46cb996f71e9dd661701, State: Running, Role: LEADER
I20260810 14:34:49.344089 24837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f59e6cc94f46cb996f71e9dd661701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45003 } }
I20260810 14:34:49.344592 24827 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:49.345755 24839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33f59e6cc94f46cb996f71e9dd661701. Latest consensus state: current_term: 1 leader_uuid: "33f59e6cc94f46cb996f71e9dd661701" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f59e6cc94f46cb996f71e9dd661701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45003 } } }
I20260810 14:34:49.345898 24839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:49.346362 24846 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:49.346314 24838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33f59e6cc94f46cb996f71e9dd661701" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f59e6cc94f46cb996f71e9dd661701" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45003 } } }
I20260810 14:34:49.346477 24838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:49.349709 24846 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:49.355346 24846 catalog_manager.cc:1347] Generated new cluster ID: c73c51f13bab4d76bab8d43fcba1784a
I20260810 14:34:49.355523 24846 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:49.383960 24846 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:49.384438 24846 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:49.390969 24846 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33f59e6cc94f46cb996f71e9dd661701: Generated new TSK 0
I20260810 14:34:49.391711 24846 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:49.395850 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24752
2026-08-10T14:34:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1470 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:49 dist-test-slave-0b58 krb5kdc[24860](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:49 dist-test-slave-0b58 krb5kdc[24860](info): set up 2 sockets
Aug 10 14:34:49 dist-test-slave-0b58 krb5kdc[24860](info): commencing operation
krb5kdc: starting...
W20260810 14:34:50.486846 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:50 dist-test-slave-0b58 krb5kdc[24860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:50.619055 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40245
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:50.735677 24873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:50.736052 24873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:50.736152 24873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:50.740468 24873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:50.740581 24873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:50.740621 24873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:50.740660 24873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:50.740695 24873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:50.746284 24873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:50.747488 24873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:50.748608 24873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:50.757373 24878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:50.757361 24880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:50.757474 24873 server_base.cc:1034] running on GCE node
W20260810 14:34:50.757364 24882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:50.758384 24873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:50.759614 24873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:50.760828 24873 hybrid_clock.cc:648] HybridClock initialized: now 1786372490760765 us; error 79 us; skew 500 ppm
Aug 10 14:34:50 dist-test-slave-0b58 krb5kdc[24860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372490, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:50.767494 24873 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:50.768750 24873 webserver.cc:460] Webserver started at http://127.0.0.1:33241/ using document root <none> and password file <none>
I20260810 14:34:50.769366 24873 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:50.769436 24873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:50.769634 24873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:50.771880 24873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "ded29516cc3b459db3e7fd4d1fac855b"
format_stamp: "Formatted at 2026-08-10 14:34:50 on dist-test-slave-0b58"
server_key: "e663c4f19e7ce4076297ab2770ee573e"
server_key_iv: "3945d4d7e173f23947f4b7172f225461"
server_key_version: "encryptionkey@0"
I20260810 14:34:50.772540 24873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "ded29516cc3b459db3e7fd4d1fac855b"
format_stamp: "Formatted at 2026-08-10 14:34:50 on dist-test-slave-0b58"
server_key: "e663c4f19e7ce4076297ab2770ee573e"
server_key_iv: "3945d4d7e173f23947f4b7172f225461"
server_key_version: "encryptionkey@0"
I20260810 14:34:50.776746 24873 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:34:50.779325 24889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:50.780709 24873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:50.780829 24873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "ded29516cc3b459db3e7fd4d1fac855b"
format_stamp: "Formatted at 2026-08-10 14:34:50 on dist-test-slave-0b58"
server_key: "e663c4f19e7ce4076297ab2770ee573e"
server_key_iv: "3945d4d7e173f23947f4b7172f225461"
server_key_version: "encryptionkey@0"
I20260810 14:34:50.780934 24873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:50.800385 24873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:50.803756 24873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:50.803936 24873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:50.811686 24873 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40245
I20260810 14:34:50.811715 24947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40245 every 8 connection(s)
I20260810 14:34:50.812739 24873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:50.815624 24948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:50.817104 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24873
I20260810 14:34:50.817252 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:50.817560 1849 external_mini_cluster.cc:1428] Setting key cc49eedbb456ce2d48bd810d5ac47d14
I20260810 14:34:50.822085 24948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b: Bootstrap starting.
I20260810 14:34:50.824517 24948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:50.825450 24948 log.cc:824] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:34:50 dist-test-slave-0b58 krb5kdc[24860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372490, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:34:50.827855 24948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b: No bootstrap required, opened a new log
I20260810 14:34:50.831490 24948 raft_consensus.cc:348] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ded29516cc3b459db3e7fd4d1fac855b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260810 14:34:50.831786 24948 raft_consensus.cc:374] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:50.831939 24948 raft_consensus.cc:729] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ded29516cc3b459db3e7fd4d1fac855b, State: Initialized, Role: FOLLOWER
I20260810 14:34:50.832474 24948 consensus_queue.cc:260] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ded29516cc3b459db3e7fd4d1fac855b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260810 14:34:50.832650 24948 raft_consensus.cc:388] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:50.832749 24948 raft_consensus.cc:482] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:50.832859 24948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:50.833020 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:50.819120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:45759 (local address 127.0.0.1:40245)
0810 14:34:50.819596 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:50.819612 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:50.819647 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:34:50.820386 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:50.820405 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:50.820767 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:50.821110 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:50.821944 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:50.822988 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:50.823872 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:50.824428 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:50.824610 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:50.827678 (+ 3068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:50.827683 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:50.827697 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:50.827725 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:50.829600 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:50.830178 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:50.830183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:50.830188 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:50.830313 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:50.830680 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:50.830688 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:50.830689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:50.831101 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:50.831346 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:50.831683 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 14:34:50.831947 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":145,"threads_started":1}
I20260810 14:34:50.834264 24948 raft_consensus.cc:504] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ded29516cc3b459db3e7fd4d1fac855b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260810 14:34:50.834652 24948 leader_election.cc:302] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ded29516cc3b459db3e7fd4d1fac855b; no voters:
I20260810 14:34:50.835026 24948 leader_election.cc:288] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:50.835114 24953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:50.835667 24953 raft_consensus.cc:686] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [term 1 LEADER]: Becoming Leader. State: Replica: ded29516cc3b459db3e7fd4d1fac855b, State: Running, Role: LEADER
I20260810 14:34:50.836055 24953 consensus_queue.cc:237] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ded29516cc3b459db3e7fd4d1fac855b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } }
I20260810 14:34:50.836467 24948 sys_catalog.cc:564] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:50.836675 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:50.839370 24954 sys_catalog.cc:455] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ded29516cc3b459db3e7fd4d1fac855b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ded29516cc3b459db3e7fd4d1fac855b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } } }
I20260810 14:34:50.839517 24954 sys_catalog.cc:458] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:50.840184 24955 sys_catalog.cc:455] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ded29516cc3b459db3e7fd4d1fac855b. Latest consensus state: current_term: 1 leader_uuid: "ded29516cc3b459db3e7fd4d1fac855b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ded29516cc3b459db3e7fd4d1fac855b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40245 } } }
I20260810 14:34:50.840318 24955 sys_catalog.cc:458] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b [sys.catalog]: This master's current role is: LEADER
W20260810 14:34:50.842460 24971 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:34:50.842612 24971 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:34:50.842734 24974 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:50.843824 24974 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:50.848081 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:50.839341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:54041 (local address 127.0.0.1:40245)
0810 14:34:50.839810 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:50.839814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:50.839832 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:34:50.839873 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:50.839875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:50.839920 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:50.840017 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:50.840801 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:50.841367 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:50.842212 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:50.842475 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:50.842587 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:50.844485 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:50.844489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:50.844492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:50.844518 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:50.846236 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:50.846725 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:50.846728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:50.846730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:50.846823 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:50.847171 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:50.847174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:50.847177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:50.847370 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:50.847526 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:50.847805 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 14:34:50.847908 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393}
I20260810 14:34:50.850325 24974 catalog_manager.cc:1347] Generated new cluster ID: fe80dd7ed89d4db89096741fab858fee
I20260810 14:34:50.850402 24974 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:50.863840 24974 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:50.865202 24974 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:50.879245 24974 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ded29516cc3b459db3e7fd4d1fac855b: Generated new TSK 0
I20260810 14:34:50.880247 24974 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:50.889911 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24873
W20260810 14:34:50.897428 24858 connection.cc:535] client connection to 127.0.0.1:40245 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40245): Connection reset by peer (error 104)
2026-08-10T14:34:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:50 dist-test-slave-0b58 krb5kdc[24980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:50 dist-test-slave-0b58 krb5kdc[24980](info): set up 2 sockets
Aug 10 14:34:50 dist-test-slave-0b58 krb5kdc[24980](info): commencing operation
krb5kdc: starting...
W20260810 14:34:51.975486 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:52 dist-test-slave-0b58 krb5kdc[24980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:52.107977 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42707
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:52.221554 24994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:52.221895 24994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:52.221984 24994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:52.229127 24994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:52.229226 24994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:52.229269 24994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:52.229307 24994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:52.229341 24994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:52.236151 24994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:52.237429 24994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:52.238507 24994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:52.247218 24999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:52.247422 24994 server_base.cc:1034] running on GCE node
W20260810 14:34:52.247227 25000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:52.247236 25002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:52.248116 24994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:52.249261 24994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:52.250468 24994 hybrid_clock.cc:648] HybridClock initialized: now 1786372492250447 us; error 43 us; skew 500 ppm
Aug 10 14:34:52 dist-test-slave-0b58 krb5kdc[24980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372492, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:52.253564 24994 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:52.254552 24994 webserver.cc:460] Webserver started at http://127.0.0.1:37813/ using document root <none> and password file <none>
I20260810 14:34:52.255137 24994 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:52.255232 24994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:52.255478 24994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:52.257678 24994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "33a89bbf9a4e4a9789d49c2f2f807305"
format_stamp: "Formatted at 2026-08-10 14:34:52 on dist-test-slave-0b58"
server_key: "22e352e991b4dc425ab9bd767bae3720"
server_key_iv: "2a782a4b052a25b4c7ae6e85cde188df"
server_key_version: "encryptionkey@0"
I20260810 14:34:52.258289 24994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "33a89bbf9a4e4a9789d49c2f2f807305"
format_stamp: "Formatted at 2026-08-10 14:34:52 on dist-test-slave-0b58"
server_key: "22e352e991b4dc425ab9bd767bae3720"
server_key_iv: "2a782a4b052a25b4c7ae6e85cde188df"
server_key_version: "encryptionkey@0"
I20260810 14:34:52.262396 24994 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:52.264974 25009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:52.266311 24994 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:34:52.266420 24994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "33a89bbf9a4e4a9789d49c2f2f807305"
format_stamp: "Formatted at 2026-08-10 14:34:52 on dist-test-slave-0b58"
server_key: "22e352e991b4dc425ab9bd767bae3720"
server_key_iv: "2a782a4b052a25b4c7ae6e85cde188df"
server_key_version: "encryptionkey@0"
I20260810 14:34:52.266566 24994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:52.321610 24994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:52.325191 24994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:52.325423 24994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:52.332937 24994 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42707
I20260810 14:34:52.332965 25065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42707 every 8 connection(s)
I20260810 14:34:52.333971 24994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:52.336231 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 24994
I20260810 14:34:52.336433 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:52.336768 1849 external_mini_cluster.cc:1428] Setting key 08c978c3bb9ef6687093975c51841d0a
I20260810 14:34:52.337076 25069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:52.343350 25069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305: Bootstrap starting.
I20260810 14:34:52.345621 25069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:52.346030 25072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:52.338279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:60775 (local address 127.0.0.1:42707)
0810 14:34:52.338745 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:52.338761 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:52.338796 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:34:52.339722 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:52.339751 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:52.340074 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:52.340439 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:52.340833 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:52.341823 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:52.342763 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:52.343236 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:52.343426 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:52.344393 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:52.344398 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:52.344410 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:52.344787 (+ 377us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:52.344841 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:52.344865 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:52.345005 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:52.345159 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 14:34:52.345294 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":152,"threads_started":1}
I20260810 14:34:52.346495 25069 log.cc:824] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:52.348791 25069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305: No bootstrap required, opened a new log
I20260810 14:34:52.349080 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:52.352768 25069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42707 } }
I20260810 14:34:52.353039 25069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:52.353133 25069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33a89bbf9a4e4a9789d49c2f2f807305, State: Initialized, Role: FOLLOWER
I20260810 14:34:52.353561 25069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42707 } }
I20260810 14:34:52.353717 25069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:52.353804 25069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:52.353925 25069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:52.354876 25069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42707 } }
I20260810 14:34:52.355221 25069 leader_election.cc:302] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33a89bbf9a4e4a9789d49c2f2f807305; no voters:
I20260810 14:34:52.355500 25072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:52.351100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:33711 (local address 127.0.0.1:42707)
0810 14:34:52.351214 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:52.351220 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:52.351451 (+ 231us) server_negotiation.cc:407] Connection header received
0810 14:34:52.351604 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:52.351607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:52.351660 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:52.351744 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:52.352023 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:52.352611 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:52.353641 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:52.354028 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:52.354123 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:52.355006 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:52.355010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:52.355012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:52.355028 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:52.355056 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:52.355068 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:52.355176 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:52.355299 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 14:34:52.355334 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:34:52.355582 25069 leader_election.cc:288] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:52.355657 25080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:52.355880 25080 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [term 1 LEADER]: Becoming Leader. State: Replica: 33a89bbf9a4e4a9789d49c2f2f807305, State: Running, Role: LEADER
I20260810 14:34:52.356225 25080 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42707 } }
I20260810 14:34:52.357007 25069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:52.357501 25080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33a89bbf9a4e4a9789d49c2f2f807305. Latest consensus state: current_term: 1 leader_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42707 } } }
I20260810 14:34:52.357631 25080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:52.357893 25080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33a89bbf9a4e4a9789d49c2f2f807305" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42707 } } }
I20260810 14:34:52.358072 25080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:52.358413 25085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:52.362200 25085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:52.368211 25085 catalog_manager.cc:1347] Generated new cluster ID: adb9db8c9cf246ceb094e81957896c03
I20260810 14:34:52.368315 25085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:52.376778 25085 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:52.377787 25085 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:52.382023 25085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33a89bbf9a4e4a9789d49c2f2f807305: Generated new TSK 0
I20260810 14:34:52.382753 25085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:52.393347 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 24994
W20260810 14:34:52.402204 24977 connection.cc:535] client connection to 127.0.0.1:42707 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42707): Connection reset by peer (error 104)
2026-08-10T14:34:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1504 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:52 dist-test-slave-0b58 krb5kdc[25101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:52 dist-test-slave-0b58 krb5kdc[25101](info): set up 2 sockets
Aug 10 14:34:52 dist-test-slave-0b58 krb5kdc[25101](info): commencing operation
krb5kdc: starting...
W20260810 14:34:53.472849 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.056s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:53 dist-test-slave-0b58 krb5kdc[25101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:53.601272 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35639
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:53.716303 25114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:53.716646 25114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:53.716732 25114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:53.720920 25114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:53.720990 25114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:53.721009 25114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:53.721026 25114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:53.721061 25114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:53.726411 25114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:53.727528 25114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:53.728647 25114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:53.737257 25121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:53.737479 25122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:53.737656 25114 server_base.cc:1034] running on GCE node
W20260810 14:34:53.737694 25124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:53.738322 25114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:53.739462 25114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:53.740650 25114 hybrid_clock.cc:648] HybridClock initialized: now 1786372493740619 us; error 45 us; skew 500 ppm
Aug 10 14:34:53 dist-test-slave-0b58 krb5kdc[25101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372493, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:53.743470 25114 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:53.744460 25114 webserver.cc:460] Webserver started at http://127.0.0.1:46453/ using document root <none> and password file <none>
I20260810 14:34:53.745045 25114 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:53.745141 25114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:53.745374 25114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:53.747478 25114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "8db421b8157e465499dd91ea53ae6b6b"
format_stamp: "Formatted at 2026-08-10 14:34:53 on dist-test-slave-0b58"
server_key: "e1ff34716e31b6c32a9bfa1337fa684a"
server_key_iv: "430238d23ecb69f757823b99f23e24a4"
server_key_version: "encryptionkey@0"
I20260810 14:34:53.748083 25114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "8db421b8157e465499dd91ea53ae6b6b"
format_stamp: "Formatted at 2026-08-10 14:34:53 on dist-test-slave-0b58"
server_key: "e1ff34716e31b6c32a9bfa1337fa684a"
server_key_iv: "430238d23ecb69f757823b99f23e24a4"
server_key_version: "encryptionkey@0"
I20260810 14:34:53.751901 25114 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:34:53.754458 25131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:53.755725 25114 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:53.755894 25114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "8db421b8157e465499dd91ea53ae6b6b"
format_stamp: "Formatted at 2026-08-10 14:34:53 on dist-test-slave-0b58"
server_key: "e1ff34716e31b6c32a9bfa1337fa684a"
server_key_iv: "430238d23ecb69f757823b99f23e24a4"
server_key_version: "encryptionkey@0"
I20260810 14:34:53.756022 25114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:53.761029 25114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:53.764591 25114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:53.764811 25114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:53.772651 25114 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35639
I20260810 14:34:53.772678 25185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35639 every 8 connection(s)
I20260810 14:34:53.773685 25114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:53.776645 25186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:53.778179 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25114
I20260810 14:34:53.778373 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:53.778682 1849 external_mini_cluster.cc:1428] Setting key cbd51e5b441b9ce900b1d0391dd04260
I20260810 14:34:53.783607 25186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b: Bootstrap starting.
I20260810 14:34:53.784610 25189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:53.780157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:32939 (local address 127.0.0.1:35639)
0810 14:34:53.780666 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:53.780685 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:53.780729 (+ 44us) server_negotiation.cc:407] Connection header received
0810 14:34:53.781620 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:53.781646 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:53.782023 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:53.782420 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:53.783160 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:53.783166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:53.783183 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:53.783197 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:53.783273 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:53.783301 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:53.783443 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:53.783512 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 14:34:53.783667 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":122,"threads_started":1}
I20260810 14:34:53.786331 25186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:53.787289 25186 log.cc:824] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:53.787678 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:53.789490 25186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b: No bootstrap required, opened a new log
I20260810 14:34:53.791747 25189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:53.789990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:56787 (local address 127.0.0.1:35639)
0810 14:34:53.790128 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:53.790132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:53.790355 (+ 223us) server_negotiation.cc:407] Connection header received
0810 14:34:53.790479 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:53.790481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:53.790510 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:53.790574 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:53.791314 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:53.791317 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:53.791319 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:53.791329 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:53.791354 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:53.791365 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:53.791434 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:53.791549 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 14:34:53.791584 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 14:34:53.794062 25186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db421b8157e465499dd91ea53ae6b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260810 14:34:53.794310 25186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:53.794369 25186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8db421b8157e465499dd91ea53ae6b6b, State: Initialized, Role: FOLLOWER
I20260810 14:34:53.794793 25186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db421b8157e465499dd91ea53ae6b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260810 14:34:53.794940 25186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:53.795007 25186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:53.795122 25186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:53.796243 25186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db421b8157e465499dd91ea53ae6b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260810 14:34:53.796636 25186 leader_election.cc:302] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8db421b8157e465499dd91ea53ae6b6b; no voters:
I20260810 14:34:53.796955 25186 leader_election.cc:288] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:53.797109 25199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:53.797351 25199 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [term 1 LEADER]: Becoming Leader. State: Replica: 8db421b8157e465499dd91ea53ae6b6b, State: Running, Role: LEADER
I20260810 14:34:53.797690 25199 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db421b8157e465499dd91ea53ae6b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } }
I20260810 14:34:53.798197 25186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:53.799490 25201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8db421b8157e465499dd91ea53ae6b6b. Latest consensus state: current_term: 1 leader_uuid: "8db421b8157e465499dd91ea53ae6b6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db421b8157e465499dd91ea53ae6b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } } }
I20260810 14:34:53.799472 25200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8db421b8157e465499dd91ea53ae6b6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8db421b8157e465499dd91ea53ae6b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35639 } } }
I20260810 14:34:53.799664 25201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:53.799733 25200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:53.800117 25210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:53.803453 25210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:53.809931 25210 catalog_manager.cc:1347] Generated new cluster ID: a00a327503c744adbb8c7c40a7a4e805
I20260810 14:34:53.810019 25210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:53.840025 25210 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:53.840452 25210 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:53.845506 25210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8db421b8157e465499dd91ea53ae6b6b: Generated new TSK 0
I20260810 14:34:53.846325 25210 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:53.855940 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25114
2026-08-10T14:34:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1461 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:53 dist-test-slave-0b58 krb5kdc[25220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:53 dist-test-slave-0b58 krb5kdc[25220](info): set up 2 sockets
Aug 10 14:34:53 dist-test-slave-0b58 krb5kdc[25220](info): commencing operation
krb5kdc: starting...
W20260810 14:34:54.939599 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:55 dist-test-slave-0b58 krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:55.079761 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45457
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:55.196915 25234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:55.197213 25234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:55.197257 25234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:55.201462 25234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:55.201550 25234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:55.201570 25234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:55.201587 25234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:55.201609 25234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:55.207186 25234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45457
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:55.208304 25234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:55.209317 25234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:55.217844 25240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:55.217913 25234 server_base.cc:1034] running on GCE node
W20260810 14:34:55.217847 25239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:55.217844 25242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:55.218752 25234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:55.219915 25234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:55.221076 25234 hybrid_clock.cc:648] HybridClock initialized: now 1786372495221039 us; error 51 us; skew 500 ppm
Aug 10 14:34:55 dist-test-slave-0b58 krb5kdc[25220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372495, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:55.223979 25234 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:55.224898 25234 webserver.cc:460] Webserver started at http://127.0.0.1:41609/ using document root <none> and password file <none>
I20260810 14:34:55.225419 25234 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:55.225479 25234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:55.225641 25234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:55.227674 25234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "99909075af614da7bed4def3e10cd831"
format_stamp: "Formatted at 2026-08-10 14:34:55 on dist-test-slave-0b58"
server_key: "ed5d2608288d0d01dfa4e49159757250"
server_key_iv: "d44d1eaf621708be1e74e665a64dd746"
server_key_version: "encryptionkey@0"
I20260810 14:34:55.228223 25234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "99909075af614da7bed4def3e10cd831"
format_stamp: "Formatted at 2026-08-10 14:34:55 on dist-test-slave-0b58"
server_key: "ed5d2608288d0d01dfa4e49159757250"
server_key_iv: "d44d1eaf621708be1e74e665a64dd746"
server_key_version: "encryptionkey@0"
I20260810 14:34:55.231983 25234 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:34:55.234543 25249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:55.235805 25234 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:55.235947 25234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "99909075af614da7bed4def3e10cd831"
format_stamp: "Formatted at 2026-08-10 14:34:55 on dist-test-slave-0b58"
server_key: "ed5d2608288d0d01dfa4e49159757250"
server_key_iv: "d44d1eaf621708be1e74e665a64dd746"
server_key_version: "encryptionkey@0"
I20260810 14:34:55.236068 25234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:55.251578 25234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:55.254822 25234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:55.255040 25234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:55.262420 25234 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45457
I20260810 14:34:55.262446 25304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45457 every 8 connection(s)
I20260810 14:34:55.263515 25234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:55.266450 25305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:55.267396 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25234
I20260810 14:34:55.267544 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:55.267902 1849 external_mini_cluster.cc:1428] Setting key c7770c2202a7272bf58ecebb735f587a
I20260810 14:34:55.272894 25305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831: Bootstrap starting.
I20260810 14:34:55.275112 25305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:55.275882 25305 log.cc:824] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:34:55 dist-test-slave-0b58 krb5kdc[25220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:34:55.277834 25305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831: No bootstrap required, opened a new log
I20260810 14:34:55.281342 25305 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99909075af614da7bed4def3e10cd831" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45457 } }
I20260810 14:34:55.281595 25305 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:55.281694 25305 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99909075af614da7bed4def3e10cd831, State: Initialized, Role: FOLLOWER
I20260810 14:34:55.282195 25305 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99909075af614da7bed4def3e10cd831" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45457 } }
I20260810 14:34:55.282372 25305 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:55.282461 25305 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:55.282562 25305 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:55.282902 25308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:55.269435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:37479 (local address 127.0.0.1:45457)
0810 14:34:55.269945 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:55.269960 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:55.269997 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:34:55.270682 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:55.270700 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:55.271051 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:55.271403 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:55.272242 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:55.273325 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:55.274198 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:55.274680 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:55.274864 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:55.277602 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:55.277607 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:55.277621 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:55.277648 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:55.279727 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:55.280300 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:55.280313 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:55.280318 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:55.280443 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:55.280813 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:55.280820 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:55.280822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:55.281199 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:55.281452 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:55.281750 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 14:34:55.281992 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":140,"threads_started":1}
I20260810 14:34:55.283596 25305 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99909075af614da7bed4def3e10cd831" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45457 } }
I20260810 14:34:55.283941 25305 leader_election.cc:302] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99909075af614da7bed4def3e10cd831; no voters:
I20260810 14:34:55.284336 25305 leader_election.cc:288] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:55.284420 25310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:55.284624 25310 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [term 1 LEADER]: Becoming Leader. State: Replica: 99909075af614da7bed4def3e10cd831, State: Running, Role: LEADER
I20260810 14:34:55.285300 25310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99909075af614da7bed4def3e10cd831" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45457 } }
I20260810 14:34:55.285704 25305 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:55.286084 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:55.286507 25310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99909075af614da7bed4def3e10cd831. Latest consensus state: current_term: 1 leader_uuid: "99909075af614da7bed4def3e10cd831" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99909075af614da7bed4def3e10cd831" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45457 } } }
I20260810 14:34:55.286624 25310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:55.286963 25311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99909075af614da7bed4def3e10cd831" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99909075af614da7bed4def3e10cd831" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45457 } } }
I20260810 14:34:55.287047 25311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:55.287032 25319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:55.290412 25319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:55.296314 25319 catalog_manager.cc:1347] Generated new cluster ID: 5903f18e23aa487b8b94d0387ecc64a9
I20260810 14:34:55.296382 25319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:55.298542 25308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:55.288478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:45359 (local address 127.0.0.1:45457)
0810 14:34:55.288583 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:55.288588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:55.288945 (+ 357us) server_negotiation.cc:407] Connection header received
0810 14:34:55.289155 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:55.289160 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:55.289216 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:55.289272 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:55.290235 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:55.291018 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:55.292185 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:55.292577 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:55.292656 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:55.294578 (+ 1922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:55.294585 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:55.294591 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:55.294623 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:55.296135 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:55.296829 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:55.296833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:55.296835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:55.296927 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:55.297335 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:55.297338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:55.297340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:55.297526 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:55.297653 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:55.298259 (+ 606us) server_negotiation.cc:299] Negotiation successful
0810 14:34:55.298394 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:34:55.304978 25319 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:55.306263 25319 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:55.310463 25319 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99909075af614da7bed4def3e10cd831: Generated new TSK 0
I20260810 14:34:55.311204 25319 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:55.319499 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25234
W20260810 14:34:55.327221 25218 connection.cc:535] client connection to 127.0.0.1:45457 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45457): Connection reset by peer (error 104)
2026-08-10T14:34:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1463 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:55 dist-test-slave-0b58 krb5kdc[25337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:55 dist-test-slave-0b58 krb5kdc[25337](info): set up 2 sockets
Aug 10 14:34:55 dist-test-slave-0b58 krb5kdc[25337](info): commencing operation
krb5kdc: starting...
W20260810 14:34:56.403589 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:56 dist-test-slave-0b58 krb5kdc[25337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:56.544493 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41995
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:56.659979 25352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:56.660389 25352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:56.660442 25352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:56.664717 25352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:56.664799 25352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:56.664820 25352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:56.664837 25352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:56.664855 25352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:56.670691 25352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41995
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:56.671898 25352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:56.672957 25352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:56.681782 25360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:56.681818 25357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:56.681892 25352 server_base.cc:1034] running on GCE node
W20260810 14:34:56.681775 25358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:56.682812 25352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:56.683992 25352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:56.685169 25352 hybrid_clock.cc:648] HybridClock initialized: now 1786372496685150 us; error 33 us; skew 500 ppm
Aug 10 14:34:56 dist-test-slave-0b58 krb5kdc[25337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:56.693485 25352 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:56.694558 25352 webserver.cc:460] Webserver started at http://127.0.0.1:33279/ using document root <none> and password file <none>
I20260810 14:34:56.695182 25352 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:56.695251 25352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:56.695482 25352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:56.697793 25352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "987d39ab3f5b49e59512bc931e4d5466"
format_stamp: "Formatted at 2026-08-10 14:34:56 on dist-test-slave-0b58"
server_key: "d8067c29af9b4f6a222c9f1acd158330"
server_key_iv: "087c9528d89ed33eccb005471484c27d"
server_key_version: "encryptionkey@0"
I20260810 14:34:56.698417 25352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "987d39ab3f5b49e59512bc931e4d5466"
format_stamp: "Formatted at 2026-08-10 14:34:56 on dist-test-slave-0b58"
server_key: "d8067c29af9b4f6a222c9f1acd158330"
server_key_iv: "087c9528d89ed33eccb005471484c27d"
server_key_version: "encryptionkey@0"
I20260810 14:34:56.702631 25352 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:34:56.705549 25367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:56.706926 25352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:34:56.707082 25352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "987d39ab3f5b49e59512bc931e4d5466"
format_stamp: "Formatted at 2026-08-10 14:34:56 on dist-test-slave-0b58"
server_key: "d8067c29af9b4f6a222c9f1acd158330"
server_key_iv: "087c9528d89ed33eccb005471484c27d"
server_key_version: "encryptionkey@0"
I20260810 14:34:56.707206 25352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:56.734750 25352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:56.738230 25352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:56.738471 25352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:56.746488 25352 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41995
I20260810 14:34:56.746515 25424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41995 every 8 connection(s)
I20260810 14:34:56.747557 25352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:56.750552 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:56.752895 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25352
I20260810 14:34:56.753018 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:56.753364 1849 external_mini_cluster.cc:1428] Setting key f22c560385b165400806b530e73fa91a
I20260810 14:34:56.757686 25425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466: Bootstrap starting.
I20260810 14:34:56.760531 25425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:56.761508 25425 log.cc:824] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:56.764156 25425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466: No bootstrap required, opened a new log
I20260810 14:34:56.764657 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:56.754993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:34503 (local address 127.0.0.1:41995)
0810 14:34:56.755474 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:56.755500 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:56.755545 (+ 45us) server_negotiation.cc:407] Connection header received
0810 14:34:56.756470 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:56.756497 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:56.756973 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:56.757375 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:56.757877 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:56.759363 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:56.760454 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:56.761191 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:56.761377 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:56.762366 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:56.762371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:56.762385 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:56.763021 (+ 636us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:56.763093 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:56.763126 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:56.763273 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:56.763506 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 14:34:56.763648 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":135,"threads_started":1}
I20260810 14:34:56.768186 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:56.768831 25425 raft_consensus.cc:348] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987d39ab3f5b49e59512bc931e4d5466" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41995 } }
I20260810 14:34:56.769083 25425 raft_consensus.cc:374] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:56.769148 25425 raft_consensus.cc:729] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987d39ab3f5b49e59512bc931e4d5466, State: Initialized, Role: FOLLOWER
I20260810 14:34:56.769663 25425 consensus_queue.cc:260] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987d39ab3f5b49e59512bc931e4d5466" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41995 } }
I20260810 14:34:56.769807 25425 raft_consensus.cc:388] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:56.769941 25425 raft_consensus.cc:482] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:56.770067 25425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:56.771376 25425 raft_consensus.cc:504] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987d39ab3f5b49e59512bc931e4d5466" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41995 } }
I20260810 14:34:56.771793 25425 leader_election.cc:302] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987d39ab3f5b49e59512bc931e4d5466; no voters:
I20260810 14:34:56.772130 25425 leader_election.cc:288] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:56.772357 25436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:56.772677 25436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [term 1 LEADER]: Becoming Leader. State: Replica: 987d39ab3f5b49e59512bc931e4d5466, State: Running, Role: LEADER
I20260810 14:34:56.773057 25436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987d39ab3f5b49e59512bc931e4d5466" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41995 } }
I20260810 14:34:56.773582 25425 sys_catalog.cc:564] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:56.774855 25438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 987d39ab3f5b49e59512bc931e4d5466. Latest consensus state: current_term: 1 leader_uuid: "987d39ab3f5b49e59512bc931e4d5466" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987d39ab3f5b49e59512bc931e4d5466" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41995 } } }
I20260810 14:34:56.775004 25438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:56.775373 25437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "987d39ab3f5b49e59512bc931e4d5466" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987d39ab3f5b49e59512bc931e4d5466" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41995 } } }
I20260810 14:34:56.775480 25437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:56.775875 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:56.770646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:58517 (local address 127.0.0.1:41995)
0810 14:34:56.770781 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:56.770785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:56.770950 (+ 165us) server_negotiation.cc:407] Connection header received
0810 14:34:56.771040 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:56.771043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:56.771095 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:56.771192 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:56.771453 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:56.772228 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:56.773527 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:56.773874 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:56.773998 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:56.775041 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:56.775045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:56.775048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:56.775063 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:56.775097 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:56.775114 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:56.775209 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:56.775672 (+ 463us) server_negotiation.cc:299] Negotiation successful
0810 14:34:56.775716 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 14:34:56.779263 25453 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:34:56.779371 25453 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:34:56.779454 25446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:56.780171 25446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:56.786326 25446 catalog_manager.cc:1347] Generated new cluster ID: 24fa799381824e0b92851d36153d3b4f
I20260810 14:34:56.786422 25446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:56.804242 25446 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:56.805330 25446 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:56.814440 25446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 987d39ab3f5b49e59512bc931e4d5466: Generated new TSK 0
I20260810 14:34:56.815200 25446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:56.823683 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25352
W20260810 14:34:56.831681 25335 connection.cc:535] client connection to 127.0.0.1:41995 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41995): Connection reset by peer (error 104)
2026-08-10T14:34:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1504 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:56 dist-test-slave-0b58 krb5kdc[25459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:56 dist-test-slave-0b58 krb5kdc[25459](info): set up 2 sockets
Aug 10 14:34:56 dist-test-slave-0b58 krb5kdc[25459](info): commencing operation
krb5kdc: starting...
W20260810 14:34:57.906932 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:57 dist-test-slave-0b58 krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:34:58.039362 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45987
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:58.154961 25472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:58.155339 25472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:58.155431 25472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:58.159723 25472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:58.159847 25472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:58.159885 25472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:58.159925 25472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:58.159965 25472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:58.166152 25472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45987
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:58.167388 25472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:58.168555 25472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:58.177656 25477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:58.177830 25472 server_base.cc:1034] running on GCE node
W20260810 14:34:58.177678 25480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:58.178042 25478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:58.178617 25472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:58.179838 25472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:58.181038 25472 hybrid_clock.cc:648] HybridClock initialized: now 1786372498181021 us; error 38 us; skew 500 ppm
Aug 10 14:34:58 dist-test-slave-0b58 krb5kdc[25459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372498, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:58.183972 25472 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:34:58.185005 25472 webserver.cc:460] Webserver started at http://127.0.0.1:39509/ using document root <none> and password file <none>
I20260810 14:34:58.185585 25472 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:58.185676 25472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:58.185922 25472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:58.187999 25472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "15db4eb40f4a4549b39bb8efcc06fc4c"
format_stamp: "Formatted at 2026-08-10 14:34:58 on dist-test-slave-0b58"
server_key: "2d0d68211eaf53fd80aad278fc06aa66"
server_key_iv: "b36e525048372da3a0b56f7c1f8dacd7"
server_key_version: "encryptionkey@0"
I20260810 14:34:58.188611 25472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "15db4eb40f4a4549b39bb8efcc06fc4c"
format_stamp: "Formatted at 2026-08-10 14:34:58 on dist-test-slave-0b58"
server_key: "2d0d68211eaf53fd80aad278fc06aa66"
server_key_iv: "b36e525048372da3a0b56f7c1f8dacd7"
server_key_version: "encryptionkey@0"
I20260810 14:34:58.192405 25472 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:34:58.194844 25487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:58.196076 25472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:58.196225 25472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "15db4eb40f4a4549b39bb8efcc06fc4c"
format_stamp: "Formatted at 2026-08-10 14:34:58 on dist-test-slave-0b58"
server_key: "2d0d68211eaf53fd80aad278fc06aa66"
server_key_iv: "b36e525048372da3a0b56f7c1f8dacd7"
server_key_version: "encryptionkey@0"
I20260810 14:34:58.196429 25472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:58.201063 25472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:58.204463 25472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:58.204660 25472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:58.212380 25472 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45987
I20260810 14:34:58.212433 25544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45987 every 8 connection(s)
I20260810 14:34:58.213339 25472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:58.216187 25545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:58.217528 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25472
I20260810 14:34:58.217693 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:58.217983 1849 external_mini_cluster.cc:1428] Setting key 0727420b348579d7aa80f852d62c804c
I20260810 14:34:58.223374 25545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c: Bootstrap starting.
I20260810 14:34:58.223815 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:58.219425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:59925 (local address 127.0.0.1:45987)
0810 14:34:58.219858 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:58.219877 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:58.219920 (+ 43us) server_negotiation.cc:407] Connection header received
0810 14:34:58.220789 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:58.220814 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:58.221173 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:58.221552 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:58.222257 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:58.222290 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:58.222310 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:58.222328 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:58.222398 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:58.222427 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:58.222564 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:58.222756 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 14:34:58.222920 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":114,"threads_started":1}
I20260810 14:34:58.225740 25545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:58.226542 25545 log.cc:824] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:58.228605 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:58.229176 25545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c: No bootstrap required, opened a new log
I20260810 14:34:58.232913 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:58.231102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.101:33679 (local address 127.0.0.1:45987)
0810 14:34:58.231210 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:58.231225 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:58.231320 (+ 95us) server_negotiation.cc:407] Connection header received
0810 14:34:58.231477 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:58.231481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:58.231514 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:58.231606 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:58.232404 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:58.232408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:58.232411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:34:58.232424 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:58.232456 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:34:58.232475 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:58.232560 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:58.232742 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 14:34:58.232784 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 14:34:58.234328 25545 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260810 14:34:58.234550 25545 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:58.234583 25545 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15db4eb40f4a4549b39bb8efcc06fc4c, State: Initialized, Role: FOLLOWER
I20260810 14:34:58.234941 25545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260810 14:34:58.235050 25545 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:58.235127 25545 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:58.235234 25545 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:58.236402 25545 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260810 14:34:58.236704 25545 leader_election.cc:302] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15db4eb40f4a4549b39bb8efcc06fc4c; no voters:
I20260810 14:34:58.236974 25545 leader_election.cc:288] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:58.237102 25555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:58.237349 25555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [term 1 LEADER]: Becoming Leader. State: Replica: 15db4eb40f4a4549b39bb8efcc06fc4c, State: Running, Role: LEADER
I20260810 14:34:58.237656 25555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } }
I20260810 14:34:58.238121 25545 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:58.239356 25557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15db4eb40f4a4549b39bb8efcc06fc4c. Latest consensus state: current_term: 1 leader_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } } }
I20260810 14:34:58.239488 25557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:58.239878 25564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:58.239828 25556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15db4eb40f4a4549b39bb8efcc06fc4c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45987 } } }
I20260810 14:34:58.240720 25556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:58.243494 25564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:58.248936 25564 catalog_manager.cc:1347] Generated new cluster ID: 27b65273cf7644edaa2669ed4650d324
I20260810 14:34:58.249010 25564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:58.264081 25564 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:58.264485 25564 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:58.268489 25564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15db4eb40f4a4549b39bb8efcc06fc4c: Generated new TSK 0
I20260810 14:34:58.269290 25564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:58.274863 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25472
2026-08-10T14:34:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:58 dist-test-slave-0b58 krb5kdc[25577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:58 dist-test-slave-0b58 krb5kdc[25577](info): set up 2 sockets
Aug 10 14:34:58 dist-test-slave-0b58 krb5kdc[25577](info): commencing operation
krb5kdc: starting...
W20260810 14:34:59.370352 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:34:59 dist-test-slave-0b58 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:34:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:34:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:34:59.501446 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44469
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:37645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:44469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:34:59.613968 25591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:34:59.614275 25591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:34:59.614349 25591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:34:59.618360 25591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:34:59.618448 25591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:34:59.618487 25591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:34:59.618546 25591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:34:59.618587 25591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:34:59.623797 25591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:37645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:44469
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:34:59.624943 25591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:34:59.625957 25591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:34:59.634362 25596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:59.634335 25597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:34:59.634348 25599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:34:59.634488 25591 server_base.cc:1034] running on GCE node
I20260810 14:34:59.635201 25591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:34:59.636356 25591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:34:59.637542 25591 hybrid_clock.cc:648] HybridClock initialized: now 1786372499637518 us; error 45 us; skew 500 ppm
Aug 10 14:34:59 dist-test-slave-0b58 krb5kdc[25577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372499, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:34:59.640347 25591 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:34:59.641163 25591 webserver.cc:460] Webserver started at http://127.1.206.126:46301/ using document root <none> and password file <none>
I20260810 14:34:59.641677 25591 fs_manager.cc:359] Metadata directory not provided
I20260810 14:34:59.641737 25591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:34:59.641901 25591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:34:59.643878 25591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "5056bc9422c44a1387369d6592a31332"
format_stamp: "Formatted at 2026-08-10 14:34:59 on dist-test-slave-0b58"
server_key: "672bc2248e2a781c4150fae9db254edc"
server_key_iv: "0b17ae6237fc6306741aa9a906608ad6"
server_key_version: "encryptionkey@0"
I20260810 14:34:59.644469 25591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "5056bc9422c44a1387369d6592a31332"
format_stamp: "Formatted at 2026-08-10 14:34:59 on dist-test-slave-0b58"
server_key: "672bc2248e2a781c4150fae9db254edc"
server_key_iv: "0b17ae6237fc6306741aa9a906608ad6"
server_key_version: "encryptionkey@0"
I20260810 14:34:59.648095 25591 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:34:59.650456 25607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:34:59.651657 25591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:34:59.651785 25591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "5056bc9422c44a1387369d6592a31332"
format_stamp: "Formatted at 2026-08-10 14:34:59 on dist-test-slave-0b58"
server_key: "672bc2248e2a781c4150fae9db254edc"
server_key_iv: "0b17ae6237fc6306741aa9a906608ad6"
server_key_version: "encryptionkey@0"
I20260810 14:34:59.651896 25591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:34:59.664693 25591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:34:59.667909 25591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:34:59.668135 25591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:34:59.675678 25591 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:44469
I20260810 14:34:59.675706 25663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:44469 every 8 connection(s)
I20260810 14:34:59.676692 25591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:34:59.677861 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25591
I20260810 14:34:59.678007 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:34:59.678321 1849 external_mini_cluster.cc:1428] Setting key 4d01e80ea40052366b7ad0c3f10f64f6
I20260810 14:34:59.679690 25664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:34:59.686342 25664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332: Bootstrap starting.
Aug 10 14:34:59 dist-test-slave-0b58 krb5kdc[25577](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:34:59.688663 25664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332: Neither blocks nor log segments found. Creating new log.
I20260810 14:34:59.689643 25664 log.cc:824] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332: Log is configured to *not* fsync() on all Append() calls
I20260810 14:34:59.691895 25664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332: No bootstrap required, opened a new log
I20260810 14:34:59.693934 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:59.679755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40097 (local address 127.1.206.126:44469)
0810 14:34:59.680216 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:59.680234 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:59.680301 (+ 67us) server_negotiation.cc:407] Connection header received
0810 14:34:59.681170 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:59.681193 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:59.681592 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:59.681947 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:59.682703 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:59.684188 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:59.685098 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:59.685795 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:59.685953 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:59.688494 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:59.688503 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:59.688521 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:59.688559 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:59.690460 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:59.690963 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:59.690969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:59.690974 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:59.691119 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:59.691437 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:59.691440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:59.691442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:59.691935 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:59.692204 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:59.692544 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 14:34:59.692777 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":133,"threads_started":1}
I20260810 14:34:59.695683 25664 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5056bc9422c44a1387369d6592a31332" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44469 } }
I20260810 14:34:59.696000 25664 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:34:59.696062 25664 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5056bc9422c44a1387369d6592a31332, State: Initialized, Role: FOLLOWER
I20260810 14:34:59.696585 25664 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5056bc9422c44a1387369d6592a31332" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44469 } }
I20260810 14:34:59.696744 25664 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:34:59.696812 25664 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:34:59.696914 25664 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:34:59.697101 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:34:59.697888 25664 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5056bc9422c44a1387369d6592a31332" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44469 } }
I20260810 14:34:59.698249 25664 leader_election.cc:302] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5056bc9422c44a1387369d6592a31332; no voters:
I20260810 14:34:59.698594 25664 leader_election.cc:288] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:34:59.698661 25673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:34:59.698882 25673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [term 1 LEADER]: Becoming Leader. State: Replica: 5056bc9422c44a1387369d6592a31332, State: Running, Role: LEADER
I20260810 14:34:59.699219 25673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5056bc9422c44a1387369d6592a31332" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44469 } }
I20260810 14:34:59.699839 25664 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:34:59.700465 25673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5056bc9422c44a1387369d6592a31332. Latest consensus state: current_term: 1 leader_uuid: "5056bc9422c44a1387369d6592a31332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5056bc9422c44a1387369d6592a31332" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44469 } } }
I20260810 14:34:59.700690 25673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:59.700891 25675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5056bc9422c44a1387369d6592a31332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5056bc9422c44a1387369d6592a31332" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44469 } } }
I20260810 14:34:59.701097 25675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332 [sys.catalog]: This master's current role is: LEADER
I20260810 14:34:59.701134 25683 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:34:59.704943 25683 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:34:59.708995 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:34:59.699332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50041 (local address 127.1.206.126:44469)
0810 14:34:59.699447 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 14:34:59.699452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:34:59.699665 (+ 213us) server_negotiation.cc:407] Connection header received
0810 14:34:59.699801 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:34:59.699804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:34:59.699846 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:34:59.699899 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:34:59.700898 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:59.701697 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:59.702855 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:34:59.703184 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:34:59.703281 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:34:59.705175 (+ 1894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:34:59.705180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:34:59.705183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:34:59.705211 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:34:59.706915 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:59.707498 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:59.707501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:59.707503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:59.707593 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:34:59.708022 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:34:59.708026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:34:59.708027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:34:59.708236 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:34:59.708404 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 14:34:59.708748 (+ 344us) server_negotiation.cc:299] Negotiation successful
0810 14:34:59.708857 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 14:34:59.711720 25683 catalog_manager.cc:1347] Generated new cluster ID: db3c656f3451441880db170f1da0b6aa
I20260810 14:34:59.711797 25683 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:34:59.729199 25683 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:34:59.730073 25683 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:34:59.740754 25683 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5056bc9422c44a1387369d6592a31332: Generated new TSK 0
I20260810 14:34:59.741446 25683 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:34:59.749806 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25591
W20260810 14:34:59.758512 25575 connection.cc:535] client connection to 127.1.206.126:44469 recv error: Network error: failed to read from TLS socket (remote: 127.1.206.126:44469): Connection reset by peer (error 104)
2026-08-10T14:34:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:34:59 dist-test-slave-0b58 krb5kdc[25698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:34:59 dist-test-slave-0b58 krb5kdc[25698](info): set up 2 sockets
Aug 10 14:34:59 dist-test-slave-0b58 krb5kdc[25698](info): commencing operation
krb5kdc: starting...
W20260810 14:35:00.843514 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:35:00 dist-test-slave-0b58 krb5kdc[25698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:35:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:35:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:35:00.977308 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45435
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:45435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:35:01.093113 25713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:01.093459 25713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:01.093554 25713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:01.097715 25713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:01.097826 25713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:01.097868 25713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:01.097906 25713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:01.097937 25713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:01.103559 25713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:45435
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:45435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:01.104799 25713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:01.105901 25713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:01.115170 25719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:01.115170 25721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:01.115424 25718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:01.115566 25713 server_base.cc:1034] running on GCE node
I20260810 14:35:01.116125 25713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:01.117304 25713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:01.118492 25713 hybrid_clock.cc:648] HybridClock initialized: now 1786372501118466 us; error 47 us; skew 500 ppm
Aug 10 14:35:01 dist-test-slave-0b58 krb5kdc[25698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372501, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:01.121493 25713 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:35:01.122525 25713 webserver.cc:460] Webserver started at http://127.1.206.126:38815/ using document root <none> and password file <none>
I20260810 14:35:01.123129 25713 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:01.123226 25713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:01.123464 25713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:01.125640 25713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "25c0585cc8c14f9da26a0f7459ce724a"
format_stamp: "Formatted at 2026-08-10 14:35:01 on dist-test-slave-0b58"
server_key: "448f3b393e5f0f7b83865eca327a5361"
server_key_iv: "dfe3375fc951b4b294c660bb96782ed2"
server_key_version: "encryptionkey@0"
I20260810 14:35:01.126266 25713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "25c0585cc8c14f9da26a0f7459ce724a"
format_stamp: "Formatted at 2026-08-10 14:35:01 on dist-test-slave-0b58"
server_key: "448f3b393e5f0f7b83865eca327a5361"
server_key_iv: "dfe3375fc951b4b294c660bb96782ed2"
server_key_version: "encryptionkey@0"
I20260810 14:35:01.130157 25713 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:35:01.132889 25729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:01.134368 25713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:35:01.134524 25713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "25c0585cc8c14f9da26a0f7459ce724a"
format_stamp: "Formatted at 2026-08-10 14:35:01 on dist-test-slave-0b58"
server_key: "448f3b393e5f0f7b83865eca327a5361"
server_key_iv: "dfe3375fc951b4b294c660bb96782ed2"
server_key_version: "encryptionkey@0"
I20260810 14:35:01.134649 25713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:01.153119 25713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:01.156782 25713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:01.157015 25713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:01.164644 25713 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:45435
I20260810 14:35:01.164675 25786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:45435 every 8 connection(s)
I20260810 14:35:01.165650 25713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:35:01.168491 25787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:01.174535 25787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a: Bootstrap starting.
I20260810 14:35:01.175495 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25713
I20260810 14:35:01.175657 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:35:01.175987 1849 external_mini_cluster.cc:1428] Setting key 6ea5111314752551a9ac74e01850794b
I20260810 14:35:01.177675 25787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:01.178612 25787 log.cc:824] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:01.181103 25787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a: No bootstrap required, opened a new log
I20260810 14:35:01.185840 25787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c0585cc8c14f9da26a0f7459ce724a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45435 } }
I20260810 14:35:01.186152 25787 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:35:01.186208 25787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25c0585cc8c14f9da26a0f7459ce724a, State: Initialized, Role: FOLLOWER
I20260810 14:35:01.186760 25790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:01.177330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54051 (local address 127.1.206.126:45435)
0810 14:35:01.177847 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:01.177870 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:01.177922 (+ 52us) server_negotiation.cc:407] Connection header received
0810 14:35:01.178880 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:01.178906 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:01.179305 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:01.179668 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:01.180100 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:01.181594 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:01.182596 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:01.183359 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:01.183531 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:01.184553 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:01.184560 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:01.184577 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:01.185129 (+ 552us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:01.185206 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:01.185239 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:01.185378 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:01.185581 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 14:35:01.185719 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":128,"threads_started":1}
I20260810 14:35:01.186699 25787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c0585cc8c14f9da26a0f7459ce724a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45435 } }
I20260810 14:35:01.186864 25787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:35:01.186923 25787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:35:01.187055 25787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:01.188248 25787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c0585cc8c14f9da26a0f7459ce724a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45435 } }
I20260810 14:35:01.188635 25787 leader_election.cc:302] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25c0585cc8c14f9da26a0f7459ce724a; no voters:
I20260810 14:35:01.189011 25787 leader_election.cc:288] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:35:01.189112 25792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:35:01.189308 25792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [term 1 LEADER]: Becoming Leader. State: Replica: 25c0585cc8c14f9da26a0f7459ce724a, State: Running, Role: LEADER
I20260810 14:35:01.189668 25792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c0585cc8c14f9da26a0f7459ce724a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45435 } }
I20260810 14:35:01.190181 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:35:01.190371 25787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:01.193397 25793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25c0585cc8c14f9da26a0f7459ce724a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c0585cc8c14f9da26a0f7459ce724a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45435 } } }
I20260810 14:35:01.193480 25794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25c0585cc8c14f9da26a0f7459ce724a. Latest consensus state: current_term: 1 leader_uuid: "25c0585cc8c14f9da26a0f7459ce724a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25c0585cc8c14f9da26a0f7459ce724a" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 45435 } } }
I20260810 14:35:01.193554 25793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:01.193584 25794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a [sys.catalog]: This master's current role is: LEADER
W20260810 14:35:01.195676 25814 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:01.195797 25814 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:35:01.195880 25815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:35:01.196785 25815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:35:01.198081 25790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:01.192743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40917 (local address 127.1.206.126:45435)
0810 14:35:01.193196 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:01.193201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:01.193356 (+ 155us) server_negotiation.cc:407] Connection header received
0810 14:35:01.193580 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:01.193584 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:01.193634 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:01.193696 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:01.194121 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:01.194908 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:01.196074 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:01.196446 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:01.196565 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:01.197557 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:01.197562 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:01.197565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:01.197579 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:01.197612 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:01.197625 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:01.197739 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:01.197893 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 14:35:01.197933 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379}
I20260810 14:35:01.203014 25815 catalog_manager.cc:1347] Generated new cluster ID: 809279022e2c4ddf81760bf712c6455e
I20260810 14:35:01.203096 25815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:35:01.227458 25815 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:35:01.228474 25815 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:35:01.241758 25815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25c0585cc8c14f9da26a0f7459ce724a: Generated new TSK 0
I20260810 14:35:01.242547 25815 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:35:01.254081 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25713
W20260810 14:35:01.262473 25696 connection.cc:535] client connection to 127.1.206.126:45435 recv error: Network error: failed to read from TLS socket (remote: 127.1.206.126:45435): Connection reset by peer (error 104)
2026-08-10T14:35:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:35:01 dist-test-slave-0b58 krb5kdc[25820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:35:01 dist-test-slave-0b58 krb5kdc[25820](info): set up 2 sockets
Aug 10 14:35:01 dist-test-slave-0b58 krb5kdc[25820](info): commencing operation
krb5kdc: starting...
W20260810 14:35:02.375897 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:35:02 dist-test-slave-0b58 krb5kdc[25820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:35:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:35:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:35:02.518839 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34985
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:44927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:34985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:35:02.637846 25836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:02.638216 25836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:02.638316 25836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:02.642638 25836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:02.642752 25836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:02.642793 25836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:02.642848 25836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:02.642886 25836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:02.648686 25836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:44927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:34985
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:02.649910 25836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:02.650993 25836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:02.660542 25844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:02.660530 25842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:02.660530 25841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:02.660960 25836 server_base.cc:1034] running on GCE node
I20260810 14:35:02.661612 25836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:02.662825 25836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:02.664021 25836 hybrid_clock.cc:648] HybridClock initialized: now 1786372502664008 us; error 37 us; skew 500 ppm
Aug 10 14:35:02 dist-test-slave-0b58 krb5kdc[25820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372502, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:02.672091 25836 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:35:02.673257 25836 webserver.cc:460] Webserver started at http://127.1.206.126:37473/ using document root <none> and password file <none>
I20260810 14:35:02.673873 25836 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:02.673944 25836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:02.674127 25836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:02.676401 25836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "365d26bd2f174aeab4508373b4e55460"
format_stamp: "Formatted at 2026-08-10 14:35:02 on dist-test-slave-0b58"
server_key: "80245be1d56a689df62a84bdf0d27baf"
server_key_iv: "32287284b88c9ef1526fad06f43666ca"
server_key_version: "encryptionkey@0"
I20260810 14:35:02.676994 25836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "365d26bd2f174aeab4508373b4e55460"
format_stamp: "Formatted at 2026-08-10 14:35:02 on dist-test-slave-0b58"
server_key: "80245be1d56a689df62a84bdf0d27baf"
server_key_iv: "32287284b88c9ef1526fad06f43666ca"
server_key_version: "encryptionkey@0"
I20260810 14:35:02.681079 25836 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 14:35:02.683627 25852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:02.685082 25836 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:35:02.685231 25836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "365d26bd2f174aeab4508373b4e55460"
format_stamp: "Formatted at 2026-08-10 14:35:02 on dist-test-slave-0b58"
server_key: "80245be1d56a689df62a84bdf0d27baf"
server_key_iv: "32287284b88c9ef1526fad06f43666ca"
server_key_version: "encryptionkey@0"
I20260810 14:35:02.685352 25836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:02.690371 25836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:02.693948 25836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:02.694172 25836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:02.701798 25836 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:34985
I20260810 14:35:02.701817 25909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:34985 every 8 connection(s)
I20260810 14:35:02.702811 25836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:35:02.705781 25910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:02.706776 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25836
I20260810 14:35:02.706923 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:35:02.707276 1849 external_mini_cluster.cc:1428] Setting key aa0e71cbff4042b7dc00ae97daf85185
I20260810 14:35:02.712726 25910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460: Bootstrap starting.
I20260810 14:35:02.712834 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:02.708745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58089 (local address 127.1.206.126:34985)
0810 14:35:02.709195 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:02.709213 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:02.709250 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:35:02.709913 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:02.709931 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:02.710211 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:02.710502 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:02.711429 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:02.711434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:02.711446 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:02.711456 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:02.711512 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:02.711532 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:02.711648 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:02.711797 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 14:35:02.712007 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":143,"threads_started":1}
I20260810 14:35:02.715482 25910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:02.715844 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:35:02.716427 25910 log.cc:824] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:02.718950 25910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460: No bootstrap required, opened a new log
I20260810 14:35:02.720296 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:02.718323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39311 (local address 127.1.206.126:34985)
0810 14:35:02.718470 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:02.718475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:02.718718 (+ 243us) server_negotiation.cc:407] Connection header received
0810 14:35:02.718868 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:02.718871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:02.718904 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:02.718981 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:02.719780 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:02.719782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:02.719784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:02.719795 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:02.719821 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:02.719832 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:02.719903 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:02.720021 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 14:35:02.720055 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 14:35:02.723261 25910 raft_consensus.cc:348] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365d26bd2f174aeab4508373b4e55460" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34985 } }
I20260810 14:35:02.723529 25910 raft_consensus.cc:374] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:35:02.723567 25910 raft_consensus.cc:729] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365d26bd2f174aeab4508373b4e55460, State: Initialized, Role: FOLLOWER
I20260810 14:35:02.724033 25910 consensus_queue.cc:260] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365d26bd2f174aeab4508373b4e55460" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34985 } }
I20260810 14:35:02.724195 25910 raft_consensus.cc:388] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:35:02.724309 25910 raft_consensus.cc:482] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:35:02.724433 25910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:02.725505 25910 raft_consensus.cc:504] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365d26bd2f174aeab4508373b4e55460" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34985 } }
I20260810 14:35:02.725910 25910 leader_election.cc:302] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 365d26bd2f174aeab4508373b4e55460; no voters:
I20260810 14:35:02.726308 25910 leader_election.cc:288] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:35:02.726487 25922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:35:02.726791 25922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [term 1 LEADER]: Becoming Leader. State: Replica: 365d26bd2f174aeab4508373b4e55460, State: Running, Role: LEADER
I20260810 14:35:02.727170 25922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365d26bd2f174aeab4508373b4e55460" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34985 } }
I20260810 14:35:02.727754 25910 sys_catalog.cc:564] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:02.729070 25923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "365d26bd2f174aeab4508373b4e55460" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365d26bd2f174aeab4508373b4e55460" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34985 } } }
I20260810 14:35:02.729225 25923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:02.729169 25925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 365d26bd2f174aeab4508373b4e55460. Latest consensus state: current_term: 1 leader_uuid: "365d26bd2f174aeab4508373b4e55460" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "365d26bd2f174aeab4508373b4e55460" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34985 } } }
I20260810 14:35:02.729305 25925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:02.729849 25932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:35:02.732966 25932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:35:02.738837 25932 catalog_manager.cc:1347] Generated new cluster ID: 1947e826d97d4b7c83ef64df672496cb
I20260810 14:35:02.738930 25932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:35:02.748515 25932 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:35:02.748904 25932 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:35:02.759676 25932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 365d26bd2f174aeab4508373b4e55460: Generated new TSK 0
I20260810 14:35:02.760676 25932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:35:02.772068 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25836
2026-08-10T14:35:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1516 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:35:02 dist-test-slave-0b58 krb5kdc[25944](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:35:02 dist-test-slave-0b58 krb5kdc[25944](info): set up 2 sockets
Aug 10 14:35:02 dist-test-slave-0b58 krb5kdc[25944](info): commencing operation
krb5kdc: starting...
W20260810 14:35:03.859920 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:35:03 dist-test-slave-0b58 krb5kdc[25944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:35:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:35:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:35:03.995527 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44637
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:44637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:35:04.112018 25957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:04.112428 25957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:04.112526 25957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:04.116863 25957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:04.116988 25957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:04.117027 25957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:04.117069 25957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:04.117103 25957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:04.123032 25957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:44637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:44637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:04.124282 25957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:04.125376 25957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:04.134445 25966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:04.134613 25957 server_base.cc:1034] running on GCE node
W20260810 14:35:04.134479 25965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:04.134438 25968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:04.135402 25957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:04.136595 25957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:04.137796 25957 hybrid_clock.cc:648] HybridClock initialized: now 1786372504137764 us; error 45 us; skew 500 ppm
Aug 10 14:35:04 dist-test-slave-0b58 krb5kdc[25944](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372504, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:04.140645 25957 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:35:04.141549 25957 webserver.cc:460] Webserver started at http://127.1.206.126:33573/ using document root <none> and password file <none>
I20260810 14:35:04.142237 25957 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:04.142314 25957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:04.142498 25957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:04.144661 25957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "70daab0a17654b7a862d2bc7041fdb9c"
format_stamp: "Formatted at 2026-08-10 14:35:04 on dist-test-slave-0b58"
server_key: "81fcb31d5f16d65a3e931a0666c63f47"
server_key_iv: "cf4c761ff38b891a4649a81456291db9"
server_key_version: "encryptionkey@0"
I20260810 14:35:04.145201 25957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "70daab0a17654b7a862d2bc7041fdb9c"
format_stamp: "Formatted at 2026-08-10 14:35:04 on dist-test-slave-0b58"
server_key: "81fcb31d5f16d65a3e931a0666c63f47"
server_key_iv: "cf4c761ff38b891a4649a81456291db9"
server_key_version: "encryptionkey@0"
I20260810 14:35:04.148973 25957 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:35:04.151397 25976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:04.152742 25957 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:35:04.152886 25957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "70daab0a17654b7a862d2bc7041fdb9c"
format_stamp: "Formatted at 2026-08-10 14:35:04 on dist-test-slave-0b58"
server_key: "81fcb31d5f16d65a3e931a0666c63f47"
server_key_iv: "cf4c761ff38b891a4649a81456291db9"
server_key_version: "encryptionkey@0"
I20260810 14:35:04.153010 25957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:04.171766 25957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:04.175328 25957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:04.175557 25957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:04.183638 25957 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:44637
I20260810 14:35:04.183707 26031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:44637 every 8 connection(s)
I20260810 14:35:04.184768 25957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:35:04.187806 26032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:04.193514 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 25957
I20260810 14:35:04.193701 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:35:04.194007 1849 external_mini_cluster.cc:1428] Setting key abd69937753cfc7014b9302c4cec156d
I20260810 14:35:04.194051 26032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c: Bootstrap starting.
I20260810 14:35:04.196823 26032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:04.197822 26032 log.cc:824] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:04.200301 26032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c: No bootstrap required, opened a new log
Aug 10 14:35:04 dist-test-slave-0b58 krb5kdc[25944](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:04.205072 26032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70daab0a17654b7a862d2bc7041fdb9c" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44637 } }
I20260810 14:35:04.205365 26032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:35:04.205432 26032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70daab0a17654b7a862d2bc7041fdb9c, State: Initialized, Role: FOLLOWER
I20260810 14:35:04.205978 26032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70daab0a17654b7a862d2bc7041fdb9c" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44637 } }
I20260810 14:35:04.206163 26032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:35:04.206257 26032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:35:04.206382 26032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:04.207378 26032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70daab0a17654b7a862d2bc7041fdb9c" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44637 } }
I20260810 14:35:04.207754 26032 leader_election.cc:302] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70daab0a17654b7a862d2bc7041fdb9c; no voters:
I20260810 14:35:04.208123 26032 leader_election.cc:288] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:35:04.208209 26038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:35:04.208504 26038 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [term 1 LEADER]: Becoming Leader. State: Replica: 70daab0a17654b7a862d2bc7041fdb9c, State: Running, Role: LEADER
I20260810 14:35:04.208876 26038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70daab0a17654b7a862d2bc7041fdb9c" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44637 } }
I20260810 14:35:04.209615 26032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:04.209743 26036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:04.195350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55129 (local address 127.1.206.126:44637)
0810 14:35:04.195770 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:04.195787 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:04.195824 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:35:04.196582 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:04.196601 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:04.196986 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:04.197294 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:04.198366 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:04.199557 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:04.200811 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:04.201345 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:04.201471 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:04.204436 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:04.204442 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:04.204459 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:04.204490 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:04.206533 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:04.207013 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:04.207019 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:04.207026 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:04.207158 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:04.207455 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:04.207460 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:04.207461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:04.207989 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:04.208279 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:04.208506 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 14:35:04.208854 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":151,"threads_started":1}
I20260810 14:35:04.210134 26038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70daab0a17654b7a862d2bc7041fdb9c. Latest consensus state: current_term: 1 leader_uuid: "70daab0a17654b7a862d2bc7041fdb9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70daab0a17654b7a862d2bc7041fdb9c" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44637 } } }
I20260810 14:35:04.210284 26038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:04.210224 26039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70daab0a17654b7a862d2bc7041fdb9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70daab0a17654b7a862d2bc7041fdb9c" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 44637 } } }
I20260810 14:35:04.210451 26039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:04.210726 26043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:35:04.213090 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:35:04.214288 26043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:35:04.220319 26043 catalog_manager.cc:1347] Generated new cluster ID: 98600396323a4b31bb3ea0106b4308fb
I20260810 14:35:04.220397 26043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:35:04.226783 26036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:04.216599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38133 (local address 127.1.206.126:44637)
0810 14:35:04.216715 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:04.216720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:04.216974 (+ 254us) server_negotiation.cc:407] Connection header received
0810 14:35:04.217180 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:04.217183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:04.217236 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:04.217326 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:04.218342 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:04.219161 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:04.220506 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:04.220855 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:04.220967 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:04.222713 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:04.222718 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:04.222721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:04.222751 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:04.224629 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:04.225179 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:04.225183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:04.225185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:04.225292 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:04.225628 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:04.225633 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:04.225635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:04.225871 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:04.225978 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:04.226447 (+ 469us) server_negotiation.cc:299] Negotiation successful
0810 14:35:04.226600 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 14:35:04.240589 26043 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:35:04.241930 26043 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:35:04.252277 26043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70daab0a17654b7a862d2bc7041fdb9c: Generated new TSK 0
I20260810 14:35:04.253113 26043 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:35:04.262883 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 25957
2026-08-10T14:35:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1491 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:35:04 dist-test-slave-0b58 krb5kdc[26065](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:35:04 dist-test-slave-0b58 krb5kdc[26065](info): set up 2 sockets
Aug 10 14:35:04 dist-test-slave-0b58 krb5kdc[26065](info): commencing operation
krb5kdc: starting...
W20260810 14:35:05.358830 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:35:05 dist-test-slave-0b58 krb5kdc[26065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:35:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:35:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:35:05.494786 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:37569
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:36939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:37569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:35:05.609613 26078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:05.609913 26078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:05.609995 26078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:05.614105 26078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:05.614182 26078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:05.614202 26078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:05.614223 26078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:05.614287 26078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:05.619768 26078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:36939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:37569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:37569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:05.620951 26078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:05.622023 26078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:05.630888 26083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:05.631151 26087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:05.630898 26084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:05.631507 26078 server_base.cc:1034] running on GCE node
I20260810 14:35:05.632123 26078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:05.633332 26078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:05.634542 26078 hybrid_clock.cc:648] HybridClock initialized: now 1786372505634520 us; error 37 us; skew 500 ppm
Aug 10 14:35:05 dist-test-slave-0b58 krb5kdc[26065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372505, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:05.637521 26078 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:35:05.638468 26078 webserver.cc:460] Webserver started at http://127.1.206.126:33703/ using document root <none> and password file <none>
I20260810 14:35:05.639047 26078 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:05.639153 26078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:05.639391 26078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:05.641690 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "abc54ff8ab054a58bc789bc92898c6f7"
format_stamp: "Formatted at 2026-08-10 14:35:05 on dist-test-slave-0b58"
server_key: "29abf4660e96750cab6dbdbd4fa92db6"
server_key_iv: "35cc0fe35422a00f7ed26b02e1151439"
server_key_version: "encryptionkey@0"
I20260810 14:35:05.642290 26078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "abc54ff8ab054a58bc789bc92898c6f7"
format_stamp: "Formatted at 2026-08-10 14:35:05 on dist-test-slave-0b58"
server_key: "29abf4660e96750cab6dbdbd4fa92db6"
server_key_iv: "35cc0fe35422a00f7ed26b02e1151439"
server_key_version: "encryptionkey@0"
I20260810 14:35:05.646238 26078 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 14:35:05.648806 26095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:05.650131 26078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:35:05.650305 26078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "abc54ff8ab054a58bc789bc92898c6f7"
format_stamp: "Formatted at 2026-08-10 14:35:05 on dist-test-slave-0b58"
server_key: "29abf4660e96750cab6dbdbd4fa92db6"
server_key_iv: "35cc0fe35422a00f7ed26b02e1151439"
server_key_version: "encryptionkey@0"
I20260810 14:35:05.650437 26078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:05.675459 26078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:05.678668 26078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:05.678913 26078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:05.686890 26078 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:37569
I20260810 14:35:05.686918 26150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:37569 every 8 connection(s)
I20260810 14:35:05.687950 26078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:35:05.690891 26151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:05.692471 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26078
I20260810 14:35:05.692644 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:35:05.692983 1849 external_mini_cluster.cc:1428] Setting key 0381de4c24bc5f26814797976583079c
I20260810 14:35:05.697515 26151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7: Bootstrap starting.
I20260810 14:35:05.699941 26151 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:05.700803 26151 log.cc:824] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:05.702515 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:05.694527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47557 (local address 127.1.206.126:37569)
0810 14:35:05.695027 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:05.695044 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:05.695082 (+ 38us) server_negotiation.cc:407] Connection header received
0810 14:35:05.695772 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:05.695791 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:05.696237 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:05.696656 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:05.697073 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:05.698115 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:05.699045 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:05.699546 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:05.699728 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:05.700702 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:05.700708 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:05.700722 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:05.701188 (+ 466us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:05.701250 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:05.701281 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:05.701394 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:05.701534 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 14:35:05.701777 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":159,"threads_started":1}
I20260810 14:35:05.703033 26151 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7: No bootstrap required, opened a new log
I20260810 14:35:05.705559 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:35:05.707136 26151 raft_consensus.cc:348] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc54ff8ab054a58bc789bc92898c6f7" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37569 } }
I20260810 14:35:05.707451 26151 raft_consensus.cc:374] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:35:05.707526 26151 raft_consensus.cc:729] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abc54ff8ab054a58bc789bc92898c6f7, State: Initialized, Role: FOLLOWER
I20260810 14:35:05.708029 26151 consensus_queue.cc:260] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc54ff8ab054a58bc789bc92898c6f7" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37569 } }
I20260810 14:35:05.708194 26151 raft_consensus.cc:388] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:35:05.708283 26151 raft_consensus.cc:482] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:35:05.708396 26151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:05.709685 26151 raft_consensus.cc:504] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc54ff8ab054a58bc789bc92898c6f7" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37569 } }
I20260810 14:35:05.710044 26151 leader_election.cc:302] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abc54ff8ab054a58bc789bc92898c6f7; no voters:
I20260810 14:35:05.710354 26151 leader_election.cc:288] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:35:05.710484 26162 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:35:05.710763 26162 raft_consensus.cc:686] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [term 1 LEADER]: Becoming Leader. State: Replica: abc54ff8ab054a58bc789bc92898c6f7, State: Running, Role: LEADER
I20260810 14:35:05.711131 26162 consensus_queue.cc:237] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc54ff8ab054a58bc789bc92898c6f7" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37569 } }
I20260810 14:35:05.711853 26151 sys_catalog.cc:564] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:05.712438 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:05.707646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34003 (local address 127.1.206.126:37569)
0810 14:35:05.707820 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:05.707825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:05.708060 (+ 235us) server_negotiation.cc:407] Connection header received
0810 14:35:05.708237 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:05.708242 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:05.708336 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:05.708425 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:05.708726 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:05.709513 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:05.710584 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:05.710920 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:05.711024 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:05.711917 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:05.711922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:05.711926 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:05.711940 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:05.711972 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:05.711985 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:05.712064 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:05.712195 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 14:35:05.712299 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 14:35:05.712472 26162 sys_catalog.cc:455] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abc54ff8ab054a58bc789bc92898c6f7. Latest consensus state: current_term: 1 leader_uuid: "abc54ff8ab054a58bc789bc92898c6f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc54ff8ab054a58bc789bc92898c6f7" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37569 } } }
I20260810 14:35:05.712599 26162 sys_catalog.cc:458] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:05.712977 26164 sys_catalog.cc:455] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abc54ff8ab054a58bc789bc92898c6f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abc54ff8ab054a58bc789bc92898c6f7" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 37569 } } }
I20260810 14:35:05.713115 26164 sys_catalog.cc:458] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:05.713888 26168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:35:05.716910 26168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:35:05.722791 26168 catalog_manager.cc:1347] Generated new cluster ID: f93a15f0de9443a6a9f04ba40011da38
I20260810 14:35:05.722880 26168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:35:05.745311 26168 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:35:05.746408 26168 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:35:05.751603 26168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abc54ff8ab054a58bc789bc92898c6f7: Generated new TSK 0
I20260810 14:35:05.752420 26168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:35:05.763345 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26078
2026-08-10T14:35:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1500 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:35:05 dist-test-slave-0b58 krb5kdc[26184](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:35:05 dist-test-slave-0b58 krb5kdc[26184](info): set up 2 sockets
Aug 10 14:35:05 dist-test-slave-0b58 krb5kdc[26184](info): commencing operation
krb5kdc: starting...
W20260810 14:35:06.860427 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:35:06 dist-test-slave-0b58 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:35:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:35:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:35:06.996397 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34209
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:40221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:34209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:35:07.117534 26199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:07.117902 26199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:07.118026 26199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:07.122308 26199 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:07.122416 26199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:07.122454 26199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:07.122506 26199 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:07.122548 26199 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:07.128208 26199 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:40221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:34209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:07.129489 26199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:07.130630 26199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:35:07.139614 26199 server_base.cc:1034] running on GCE node
W20260810 14:35:07.139544 26207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:07.139547 26209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:07.139545 26206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:07.140492 26199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:07.141702 26199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:07.142904 26199 hybrid_clock.cc:648] HybridClock initialized: now 1786372507142878 us; error 46 us; skew 500 ppm
Aug 10 14:35:07 dist-test-slave-0b58 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372507, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:07.145881 26199 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:35:07.146852 26199 webserver.cc:460] Webserver started at http://127.1.206.126:41437/ using document root <none> and password file <none>
I20260810 14:35:07.147462 26199 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:07.147565 26199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:07.147811 26199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:07.150142 26199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "809efcec07a344edaa770aa835ec1fbf"
format_stamp: "Formatted at 2026-08-10 14:35:07 on dist-test-slave-0b58"
server_key: "d0742f206889d51f2b16b51e12102271"
server_key_iv: "0d58f3843e7740509caa1016956adf65"
server_key_version: "encryptionkey@0"
I20260810 14:35:07.150828 26199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "809efcec07a344edaa770aa835ec1fbf"
format_stamp: "Formatted at 2026-08-10 14:35:07 on dist-test-slave-0b58"
server_key: "d0742f206889d51f2b16b51e12102271"
server_key_iv: "0d58f3843e7740509caa1016956adf65"
server_key_version: "encryptionkey@0"
I20260810 14:35:07.155216 26199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 14:35:07.158061 26216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:07.159415 26199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:35:07.159581 26199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "809efcec07a344edaa770aa835ec1fbf"
format_stamp: "Formatted at 2026-08-10 14:35:07 on dist-test-slave-0b58"
server_key: "d0742f206889d51f2b16b51e12102271"
server_key_iv: "0d58f3843e7740509caa1016956adf65"
server_key_version: "encryptionkey@0"
I20260810 14:35:07.159720 26199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:07.165343 26199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:07.169051 26199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:07.169327 26199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:07.177021 26199 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:34209
I20260810 14:35:07.177080 26275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:34209 every 8 connection(s)
I20260810 14:35:07.178058 26199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:35:07.181003 26276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:07.184532 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26199
I20260810 14:35:07.184700 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:35:07.184981 1849 external_mini_cluster.cc:1428] Setting key fa5e050a42a3ff35013c9f34383a085b
I20260810 14:35:07.187881 26276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf: Bootstrap starting.
I20260810 14:35:07.190924 26276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:07.191161 26279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:07.186504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47669 (local address 127.1.206.126:34209)
0810 14:35:07.186990 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:07.187017 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:07.187063 (+ 46us) server_negotiation.cc:407] Connection header received
0810 14:35:07.187954 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:07.187983 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:07.188396 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:07.188774 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:07.189588 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:07.189595 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:07.189610 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:07.189626 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:07.189695 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:07.189724 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:07.189874 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:07.190024 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 14:35:07.190192 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":134,"threads_started":1}
I20260810 14:35:07.191901 26276 log.cc:824] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:07.194259 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:35:07.194288 26276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf: No bootstrap required, opened a new log
I20260810 14:35:07.198153 26279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:07.196454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42087 (local address 127.1.206.126:34209)
0810 14:35:07.196590 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:07.196595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:07.196782 (+ 187us) server_negotiation.cc:407] Connection header received
0810 14:35:07.196885 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:07.196888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:07.196930 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:07.197020 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:07.197751 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:07.197758 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:07.197763 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:35:07.197777 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:07.197807 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:35:07.197820 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:07.197919 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:07.197968 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 14:35:07.198006 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 14:35:07.198661 26276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "809efcec07a344edaa770aa835ec1fbf" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34209 } }
I20260810 14:35:07.198933 26276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:35:07.199023 26276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 809efcec07a344edaa770aa835ec1fbf, State: Initialized, Role: FOLLOWER
I20260810 14:35:07.199544 26276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "809efcec07a344edaa770aa835ec1fbf" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34209 } }
I20260810 14:35:07.199731 26276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:35:07.199803 26276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:35:07.199901 26276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:07.200992 26276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "809efcec07a344edaa770aa835ec1fbf" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34209 } }
I20260810 14:35:07.201359 26276 leader_election.cc:302] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 809efcec07a344edaa770aa835ec1fbf; no voters:
I20260810 14:35:07.201695 26276 leader_election.cc:288] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:35:07.201850 26286 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:35:07.202128 26286 raft_consensus.cc:686] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [term 1 LEADER]: Becoming Leader. State: Replica: 809efcec07a344edaa770aa835ec1fbf, State: Running, Role: LEADER
I20260810 14:35:07.202554 26286 consensus_queue.cc:237] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "809efcec07a344edaa770aa835ec1fbf" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34209 } }
I20260810 14:35:07.203027 26276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:07.204421 26288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 809efcec07a344edaa770aa835ec1fbf. Latest consensus state: current_term: 1 leader_uuid: "809efcec07a344edaa770aa835ec1fbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "809efcec07a344edaa770aa835ec1fbf" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34209 } } }
I20260810 14:35:07.204471 26287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "809efcec07a344edaa770aa835ec1fbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "809efcec07a344edaa770aa835ec1fbf" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 34209 } } }
I20260810 14:35:07.204557 26288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:07.204573 26287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf [sys.catalog]: This master's current role is: LEADER
W20260810 14:35:07.208128 26302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:07.208216 26302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:35:07.208292 26297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:35:07.209221 26297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:35:07.214982 26297 catalog_manager.cc:1347] Generated new cluster ID: 541506611f5a47a889136c41345e0615
I20260810 14:35:07.215070 26297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:35:07.246615 26297 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:35:07.247095 26297 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:35:07.256893 26297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 809efcec07a344edaa770aa835ec1fbf: Generated new TSK 0
I20260810 14:35:07.257829 26297 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:35:07.268610 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26199
2026-08-10T14:35:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1505 ms)
[----------] 18 tests from AuthTokenIssuingTest (26789 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:35:07 dist-test-slave-0b58 krb5kdc[26308](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:35:07 dist-test-slave-0b58 krb5kdc[26308](info): set up 2 sockets
Aug 10 14:35:07 dist-test-slave-0b58 krb5kdc[26308](info): commencing operation
krb5kdc: starting...
W20260810 14:35:08.363612 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:35:08 dist-test-slave-0b58 krb5kdc[26308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:35:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:35:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:35:08.499547 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:36877
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:36877,127.1.206.125:40365,127.1.206.124:38157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:35:08.613258 26321 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:35:08.613638 26321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:08.613716 26321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:08.613801 26321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:08.618009 26321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:08.618129 26321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:08.618168 26321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:08.618207 26321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:08.618240 26321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:08.623857 26321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:36877,127.1.206.125:40365,127.1.206.124:38157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:36877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:08.625105 26321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:08.626232 26321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:08.635128 26326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:08.635345 26321 server_base.cc:1034] running on GCE node
W20260810 14:35:08.635177 26329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:08.635134 26327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:08.636152 26321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:08.637331 26321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:08.638540 26321 hybrid_clock.cc:648] HybridClock initialized: now 1786372508638520 us; error 35 us; skew 500 ppm
Aug 10 14:35:08 dist-test-slave-0b58 krb5kdc[26308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:08.646764 26321 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:35:08.647835 26321 webserver.cc:460] Webserver started at http://127.1.206.126:44475/ using document root <none> and password file <none>
I20260810 14:35:08.648518 26321 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:08.648627 26321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:08.648871 26321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:08.651116 26321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "bdd0584a60c746d0b68dde2c4c0c5080"
format_stamp: "Formatted at 2026-08-10 14:35:08 on dist-test-slave-0b58"
server_key: "20c02e7be55c8378d40a493bb573ec6d"
server_key_iv: "af09717477a45b371c310115bf885d98"
server_key_version: "encryptionkey@0"
I20260810 14:35:08.651767 26321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "bdd0584a60c746d0b68dde2c4c0c5080"
format_stamp: "Formatted at 2026-08-10 14:35:08 on dist-test-slave-0b58"
server_key: "20c02e7be55c8378d40a493bb573ec6d"
server_key_iv: "af09717477a45b371c310115bf885d98"
server_key_version: "encryptionkey@0"
I20260810 14:35:08.656082 26321 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 14:35:08.659117 26336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:08.660825 26321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 14:35:08.661036 26321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "bdd0584a60c746d0b68dde2c4c0c5080"
format_stamp: "Formatted at 2026-08-10 14:35:08 on dist-test-slave-0b58"
server_key: "20c02e7be55c8378d40a493bb573ec6d"
server_key_iv: "af09717477a45b371c310115bf885d98"
server_key_version: "encryptionkey@0"
I20260810 14:35:08.661183 26321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:08.673681 26321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:08.677279 26321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:08.677553 26321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:08.685276 26321 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:36877
I20260810 14:35:08.685591 26392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:36877 every 8 connection(s)
I20260810 14:35:08.686381 26321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:35:08.687130 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26321
I20260810 14:35:08.687281 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:35:08.687592 1849 external_mini_cluster.cc:1428] Setting key 0aea0451cf76a952fe2063119f59c647
I20260810 14:35:08.689703 26393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:08.694056 26393 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.206.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.125@KRBTEST.COM" created.
Aug 10 14:35:08 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:08.710167 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.696626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:36877 (local address 127.0.0.1:49112)
0810 14:35:08.697260 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.697320 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:08.698313 (+ 993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:08.699016 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:08.699021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:08.699484 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:08.699742 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.699757 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.701028 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.701031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.701783 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.701794 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.702475 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.702479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.702595 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.703281 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:08.703300 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:08.704876 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:08.706967 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.706978 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.706989 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.707225 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.707560 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.707565 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.707567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.707684 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.708368 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:08.708375 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:08.708529 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 14:35:08.708709 (+ 180us) client_negotiation.cc:240] Negotiation successful
0810 14:35:08.709129 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":109,"thread_start_us":144,"threads_started":1}
I20260810 14:35:08.710167 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.696626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.1.206.126:36877)
0810 14:35:08.697134 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:08.697159 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:08.697445 (+ 286us) server_negotiation.cc:407] Connection header received
0810 14:35:08.698613 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:08.698618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:08.698812 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:08.699016 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:08.699899 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.700883 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.701915 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.702307 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.702488 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.705034 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:08.705047 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:08.705058 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:08.705080 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:08.706845 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.707340 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.707346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.707347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.707462 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.707796 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.707799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.707801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.708202 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:08.708409 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:08.708784 (+ 375us) server_negotiation.cc:299] Negotiation successful
0810 14:35:08.709048 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"spinlock_wait_cycles":41344,"thread_start_us":199,"threads_started":1}
I20260810 14:35:08.712589 26393 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:08.713420 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.713116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55714)
0810 14:35:08.713270 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.713349 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260810 14:35:08.713689 26338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
I20260810 14:35:08.714643 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.714395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55720)
0810 14:35:08.714535 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.714589 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260810 14:35:08.714824 26393 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:40365: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab.
Entry for principal kudu/127.1.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab.
I20260810 14:35:08.717797 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:40365
--webserver_interface=127.1.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab
--principal=kudu/127.1.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:36877,127.1.206.125:40365,127.1.206.124:38157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:35:08.764150 26393 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } attempt: 1
I20260810 14:35:08.765175 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.764855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55726)
0810 14:35:08.765009 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.765074 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 14:35:08.765964 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.765778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55736)
0810 14:35:08.765866 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.765912 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 14:35:08.766155 26393 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:40365: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
I20260810 14:35:08.834335 26393 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } attempt: 2
I20260810 14:35:08.835278 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.834928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55752)
0810 14:35:08.835093 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.835159 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 14:35:08.836194 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.835865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55756)
0810 14:35:08.836058 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.836116 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260810 14:35:08.836441 26393 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:40365: Network error: Client connection negotiation failed: client connection to 127.1.206.125:40365: connect: Connection refused (error 111)
W20260810 14:35:08.837766 26402 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:35:08.838291 26402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:08.838358 26402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:08.838423 26402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:08.845981 26402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:08.846071 26402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:08.846123 26402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:08.846189 26402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:08.846236 26402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:08.855933 26402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:36877,127.1.206.125:40365,127.1.206.124:38157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab
--principal=kudu/127.1.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:40365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:08.857635 26402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:08.859151 26402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:08.870023 26410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:08.870266 26407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:08.870038 26408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:08.872380 26402 server_base.cc:1034] running on GCE node
I20260810 14:35:08.873225 26402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:08.874902 26402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:08.876124 26402 hybrid_clock.cc:648] HybridClock initialized: now 1786372508876086 us; error 48 us; skew 500 ppm
Aug 10 14:35:08 dist-test-slave-0b58 krb5kdc[26308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:08.880070 26402 init.cc:377] Logged in from keytab as kudu/127.1.206.125@KRBTEST.COM (short username kudu)
I20260810 14:35:08.881528 26402 webserver.cc:460] Webserver started at http://127.1.206.125:45015/ using document root <none> and password file <none>
I20260810 14:35:08.882380 26402 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:08.882491 26402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:08.882792 26402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:08.886129 26402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data/instance:
uuid: "60ced62f90a3464d8f04820a923d676d"
format_stamp: "Formatted at 2026-08-10 14:35:08 on dist-test-slave-0b58"
server_key: "52e2c8c6f432a50877b1f6319eb6acd9"
server_key_iv: "84ac432f99b2242fbce285f5eb87d928"
server_key_version: "encryptionkey@0"
I20260810 14:35:08.887005 26402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/wal/instance:
uuid: "60ced62f90a3464d8f04820a923d676d"
format_stamp: "Formatted at 2026-08-10 14:35:08 on dist-test-slave-0b58"
server_key: "52e2c8c6f432a50877b1f6319eb6acd9"
server_key_iv: "84ac432f99b2242fbce285f5eb87d928"
server_key_version: "encryptionkey@0"
I20260810 14:35:08.891752 26402 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 14:35:08.894585 26418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:08.896082 26402 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 14:35:08.896214 26402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/wal
uuid: "60ced62f90a3464d8f04820a923d676d"
format_stamp: "Formatted at 2026-08-10 14:35:08 on dist-test-slave-0b58"
server_key: "52e2c8c6f432a50877b1f6319eb6acd9"
server_key_iv: "84ac432f99b2242fbce285f5eb87d928"
server_key_version: "encryptionkey@0"
I20260810 14:35:08.896436 26402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:08.912217 26402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:08.915460 26402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:08.915712 26402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:08.922861 26402 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.125:40365
I20260810 14:35:08.923172 26472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.125:40365 every 8 connection(s)
I20260810 14:35:08.923906 26402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
I20260810 14:35:08.926018 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26402
I20260810 14:35:08.926141 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-1/wal/instance
I20260810 14:35:08.926483 1849 external_mini_cluster.cc:1428] Setting key 78c8e2ecde188f225d9bdc1bb49c86f3
I20260810 14:35:08.926911 26473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:08.927660 26393 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } attempt: 3
I20260810 14:35:08.933208 26473 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.206.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.124@KRBTEST.COM" created.
Aug 10 14:35:08 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
Aug 10 14:35:08 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:08.944545 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.928299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55768)
0810 14:35:08.928528 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.928546 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:08.928643 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:08.931167 (+ 2524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:08.931173 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:08.931409 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:08.931574 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.931583 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.933441 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.933446 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.934373 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.934391 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.935302 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.935306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.935430 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.936326 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:08.936341 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:08.939201 (+ 2860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:08.942146 (+ 2945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.942151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.942156 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.942435 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.942798 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.942805 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.942810 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.942915 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.943929 (+ 1014us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:08.943932 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:08.944046 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 14:35:08.944161 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 14:35:08.944373 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260810 14:35:08.945568 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.929049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.1.206.125:40365)
0810 14:35:08.929477 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:08.929499 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:08.929544 (+ 45us) server_negotiation.cc:407] Connection header received
0810 14:35:08.930361 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:08.930385 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:08.930811 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:08.931189 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:08.931743 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.933280 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.934532 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.935146 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.935781 (+ 635us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.939434 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:08.939444 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:08.939458 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:08.939496 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:08.941990 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.942550 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.942556 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.942562 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.942681 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.943330 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.943335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.943337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.943800 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:08.943948 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:08.944357 (+ 409us) server_negotiation.cc:299] Negotiation successful
0810 14:35:08.944667 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":144,"threads_started":1}
I20260810 14:35:08.946760 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.935257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49128 (local address 127.1.206.126:36877)
0810 14:35:08.935386 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:08.935390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:08.935780 (+ 390us) server_negotiation.cc:407] Connection header received
0810 14:35:08.935998 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:08.936004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:08.936061 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:08.936152 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:08.937068 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.937677 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.938707 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.939787 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.939932 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.942406 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:08.942413 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:08.942419 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:08.942453 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:08.944379 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.945064 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.945070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.945074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.945174 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.945547 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.945553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.945557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.945829 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:08.945920 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:08.946484 (+ 564us) server_negotiation.cc:299] Negotiation successful
0810 14:35:08.946606 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 14:35:08.946807 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.935057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:36877 (local address 127.0.0.1:49128)
0810 14:35:08.935640 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.935696 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:08.935867 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:08.936233 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:08.936238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:08.936753 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:08.936949 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.936957 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.937797 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.937799 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.938543 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.938573 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.939948 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.939955 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.940113 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.940735 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:08.940747 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:08.942267 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:08.944514 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.944527 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.944536 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.944922 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.945308 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.945313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.945317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.945422 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.946023 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:08.946032 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:08.946210 (+ 178us) client_negotiation.cc:769] Sending connection context
0810 14:35:08.946383 (+ 173us) client_negotiation.cc:240] Negotiation successful
0810 14:35:08.946586 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":159,"threads_started":1}
I20260810 14:35:08.947899 26393 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:08.948098 26473 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:08.948660 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.948396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38184)
0810 14:35:08.948519 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.948573 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 14:35:08.949415 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.949156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38186)
0810 14:35:08.949299 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.949346 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260810 14:35:08.949569 26393 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38157: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Aug 10 14:35:08 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
I20260810 14:35:08.956568 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.948611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55774)
0810 14:35:08.948746 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.948762 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:08.948844 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:08.949292 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:08.949297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:08.949446 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:08.949567 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.949574 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.950393 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.950396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.950905 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:08.950913 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.951383 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.951386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:08.951476 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.951973 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:08.951987 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:08.953356 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:08.954986 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.954990 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.954992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.955190 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.955468 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:08.955473 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:08.955475 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:08.955561 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:08.955941 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:08.955944 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:08.956032 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 14:35:08.956175 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 14:35:08.956391 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 14:35:08.956578 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.948803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55774 (local address 127.1.206.125:40365)
0810 14:35:08.948992 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:08.948996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:08.949011 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:35:08.949054 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:08.949057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:08.949097 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:08.949176 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:08.949699 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.950276 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.951027 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:08.951273 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:08.951384 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:08.953483 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:08.953487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:08.953489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:08.953511 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:08.954846 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.955291 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.955297 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.955299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.955378 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:08.955656 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:08.955661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:08.955663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:08.955836 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:08.955942 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:08.956220 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 14:35:08.956454 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":109,"server-negotiator.queue_time_us":102}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab.
Entry for principal kudu/127.1.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab.
I20260810 14:35:08.957654 26473 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:08.957769 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:38157
--webserver_interface=127.1.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab
--principal=kudu/127.1.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:36877,127.1.206.125:40365,127.1.206.124:38157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:35:08.958550 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.958195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38190)
0810 14:35:08.958351 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.958455 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 14:35:08.959146 26420 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
I20260810 14:35:08.960088 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.959817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38206)
0810 14:35:08.959945 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.960009 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 14:35:08.960299 26473 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38157: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
I20260810 14:35:08.980741 26393 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } attempt: 1
I20260810 14:35:08.981667 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.981294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38214)
0810 14:35:08.981488 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.981570 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260810 14:35:08.982515 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:08.982268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38224)
0810 14:35:08.982387 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:08.982444 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 14:35:08.982756 26393 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38157: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
I20260810 14:35:09.009599 26473 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } attempt: 1
I20260810 14:35:09.010525 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.010209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38234)
0810 14:35:09.010373 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.010445 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260810 14:35:09.011368 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.011143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38242)
0810 14:35:09.011261 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.011314 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 14:35:09.011564 26473 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38157: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
I20260810 14:35:09.057976 26393 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } attempt: 2
I20260810 14:35:09.058917 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.058542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38244)
0810 14:35:09.058721 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.058808 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260810 14:35:09.059733 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.059479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38246)
0810 14:35:09.059603 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.059662 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 14:35:09.059960 26393 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38157: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
W20260810 14:35:09.075363 26480 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:35:09.075663 26480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:09.075752 26480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:09.075826 26480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 14:35:09.079725 26473 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } attempt: 2
W20260810 14:35:09.080045 26480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:09.080134 26480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:09.080176 26480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:09.080204 26480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:09.080240 26480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:09.080662 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.080340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38248)
0810 14:35:09.080492 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.080556 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 14:35:09.081475 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.081267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38264)
0810 14:35:09.081371 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.081420 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 14:35:09.081689 26473 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38157: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38157: connect: Connection refused (error 111)
I20260810 14:35:09.086047 26480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:36877,127.1.206.125:40365,127.1.206.124:38157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab
--principal=kudu/127.1.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:38157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:09.087163 26480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:09.088219 26480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:09.096882 26486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:09.096882 26489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:09.096871 26487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:09.097211 26480 server_base.cc:1034] running on GCE node
I20260810 14:35:09.097759 26480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:09.098830 26480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:09.099994 26480 hybrid_clock.cc:648] HybridClock initialized: now 1786372509099975 us; error 30 us; skew 500 ppm
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372509, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:09.102797 26480 init.cc:377] Logged in from keytab as kudu/127.1.206.124@KRBTEST.COM (short username kudu)
I20260810 14:35:09.103664 26480 webserver.cc:460] Webserver started at http://127.1.206.124:43465/ using document root <none> and password file <none>
I20260810 14:35:09.104364 26480 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:09.104461 26480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:09.104676 26480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:09.106698 26480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data/instance:
uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41"
format_stamp: "Formatted at 2026-08-10 14:35:09 on dist-test-slave-0b58"
server_key: "4a634d3ee326ed16a21adbc1be008671"
server_key_iv: "030baf2000b042e8ce0bb3413424b547"
server_key_version: "encryptionkey@0"
I20260810 14:35:09.107283 26480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/wal/instance:
uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41"
format_stamp: "Formatted at 2026-08-10 14:35:09 on dist-test-slave-0b58"
server_key: "4a634d3ee326ed16a21adbc1be008671"
server_key_iv: "030baf2000b042e8ce0bb3413424b547"
server_key_version: "encryptionkey@0"
I20260810 14:35:09.111186 26480 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 14:35:09.113637 26496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:09.114806 26480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:35:09.114951 26480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/wal
uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41"
format_stamp: "Formatted at 2026-08-10 14:35:09 on dist-test-slave-0b58"
server_key: "4a634d3ee326ed16a21adbc1be008671"
server_key_iv: "030baf2000b042e8ce0bb3413424b547"
server_key_version: "encryptionkey@0"
I20260810 14:35:09.115067 26480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:09.131871 26480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:09.135310 26480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:09.135571 26480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:09.142825 26480 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.124:38157
I20260810 14:35:09.143124 26552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.124:38157 every 8 connection(s)
I20260810 14:35:09.143857 26480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
I20260810 14:35:09.145403 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26480
I20260810 14:35:09.145537 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786372219863018-1849-0/minicluster-data/master-2/wal/instance
I20260810 14:35:09.145820 1849 external_mini_cluster.cc:1428] Setting key 60496714c90cc73c8830f1eb942aac5b
I20260810 14:35:09.147028 26553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:09.151744 26553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
I20260810 14:35:09.159152 26393 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } attempt: 3
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372509, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:09.162521 26556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.147197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38268 (local address 127.1.206.124:38157)
0810 14:35:09.147609 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.147628 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.147670 (+ 42us) server_negotiation.cc:407] Connection header received
0810 14:35:09.148576 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.148599 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.149008 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.149358 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.150068 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.151557 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.152561 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.153240 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.153377 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.156447 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.156452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.156462 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.156489 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.158291 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.158821 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.158826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.158831 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.158941 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.159308 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.159312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.159313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.159860 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.161003 (+ 1143us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.161182 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.161494 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":113,"threads_started":1}
I20260810 14:35:09.163880 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.153755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49140 (local address 127.1.206.126:36877)
0810 14:35:09.153941 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.153946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.154344 (+ 398us) server_negotiation.cc:407] Connection header received
0810 14:35:09.154482 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.154485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.154549 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.154651 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.155425 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.155994 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.157063 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.157492 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.157609 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.159952 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.159958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.159961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.159990 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.161969 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.162438 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.162441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.162443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.162532 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.162860 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.162863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.162865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.163087 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.163161 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.163581 (+ 420us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.163728 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260810 14:35:09.164140 26557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.153678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:36877 (local address 127.0.0.1:49140)
0810 14:35:09.154185 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.154245 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:09.154363 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:09.154735 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:09.154740 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:09.155067 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:09.155268 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.155279 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.156121 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.156124 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.156928 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.156942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.157626 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.157629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.157721 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.158210 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:09.158222 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:09.159777 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:09.162081 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.162091 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.162097 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.162333 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.162656 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.162659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.162661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.162748 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.163251 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:09.163256 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:09.163368 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 14:35:09.163506 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 14:35:09.163684 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":121,"threads_started":1}
I20260810 14:35:09.165423 26553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
I20260810 14:35:09.170822 26397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.159643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38282)
0810 14:35:09.159860 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.159877 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:09.159964 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:09.160407 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:09.160411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:09.160592 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:09.160682 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.160688 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.161708 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.161712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.162471 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.162483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.164050 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.164054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.164167 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.164667 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:09.164681 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:09.166527 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:09.168986 (+ 2459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.168991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.168993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.169281 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.169596 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.169601 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.169606 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.169709 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.170238 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:09.170243 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:09.170362 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 14:35:09.170488 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 14:35:09.170623 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372509, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
I20260810 14:35:09.171337 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.159740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38282 (local address 127.1.206.124:38157)
0810 14:35:09.160119 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.160129 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.160145 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:35:09.160180 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.160183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.160231 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.160389 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.160801 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.161571 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.162602 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.163892 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.164411 (+ 519us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.167061 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.167064 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.167067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.167112 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.168882 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.169385 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.169388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.169390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.169475 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.169852 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.169855 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.169857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.170103 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.170223 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.171081 (+ 858us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.171203 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":125,"threads_started":1}
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:09.172868 26473 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } attempt: 3
I20260810 14:35:09.175246 26557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.165922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:40365 (local address 127.0.0.1:55784)
0810 14:35:09.166199 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.166222 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:09.166297 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:09.166645 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:09.166648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:09.166795 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:09.166924 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.166931 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.167868 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.167873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.168767 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.168780 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.169395 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.169398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.169524 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.169938 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:09.169951 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:09.171355 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:09.173648 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.173651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.173653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.173909 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.174248 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.174251 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.174253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.174355 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.174743 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:09.174747 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:09.174846 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 14:35:09.174955 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 14:35:09.175085 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260810 14:35:09.175263 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.166196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55784 (local address 127.1.206.125:40365)
0810 14:35:09.166378 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.166384 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.166400 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:35:09.166449 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.166452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.166509 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.166605 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.167043 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.167750 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.168917 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.169181 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.169241 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.171517 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.171524 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.171528 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.171560 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.173528 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.174022 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.174025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.174027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.174129 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.174440 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.174444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.174445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.174633 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.174751 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.175009 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.175130 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 14:35:09.175657 26393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080: Bootstrap starting.
I20260810 14:35:09.175949 26553 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:09.176666 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.165692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49154 (local address 127.1.206.126:36877)
0810 14:35:09.165828 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.165834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.165867 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:35:09.165904 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.165907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.165975 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.166047 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.166887 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.167609 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.168669 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.168903 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.169018 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.172131 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.172134 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.172137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.172160 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.174283 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.174770 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.174773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.174775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.174857 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.175164 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.175167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.175168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.175812 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.175992 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.176385 (+ 393us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.176507 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 14:35:09.178658 26393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:09.179643 26393 log.cc:824] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080: Log is configured to *not* fsync() on all Append() calls
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
I20260810 14:35:09.182624 26393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080: No bootstrap required, opened a new log
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
I20260810 14:35:09.185997 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.173284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38296)
0810 14:35:09.173456 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.173467 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:09.173530 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:09.176993 (+ 3463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:09.176997 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:09.177183 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:09.177293 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.177300 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.178562 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.178565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.179342 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.179351 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.180194 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.180198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.180353 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.180849 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:09.180866 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:09.182303 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:09.184333 (+ 2030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.184336 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.184338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.184642 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.184954 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.184959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.184961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.185055 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.185507 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:09.185510 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:09.185604 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 14:35:09.185687 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:35:09.185821 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":5}
I20260810 14:35:09.186658 26556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.173325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38296 (local address 127.1.206.124:38157)
0810 14:35:09.176759 (+ 3434us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.176764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.176777 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:35:09.176813 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.176816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.176855 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.177629 (+ 774us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.177720 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.178440 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.179708 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.180050 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.180578 (+ 528us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.182457 (+ 1879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.182460 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.182463 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.182486 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.184168 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.184757 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.184761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.184762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.184845 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.185168 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.185171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.185173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.185389 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.186307 (+ 918us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.186389 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.186510 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3362}
I20260810 14:35:09.187237 26393 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.187487 26393 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdd0584a60c746d0b68dde2c4c0c5080, State: Initialized, Role: FOLLOWER
I20260810 14:35:09.187839 26393 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.188145 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.177835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55786 (local address 127.1.206.125:40365)
0810 14:35:09.177929 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.177933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.178745 (+ 812us) server_negotiation.cc:407] Connection header received
0810 14:35:09.178826 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.178829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.178871 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.178949 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.179689 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.180354 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.181167 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.181393 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.181495 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.183954 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.183957 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.183959 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.183980 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.185760 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.186257 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.186261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.186262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.186353 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.186688 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.186694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.186695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.186937 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.187129 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.187845 (+ 716us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.187969 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 14:35:09 dist-test-slave-0b58 krb5kdc[26308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372509, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
I20260810 14:35:09.189378 26393 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:09.189875 26473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: Bootstrap starting.
I20260810 14:35:09.193324 26473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:09.193338 26557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.176469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38157 (local address 127.0.0.1:38308)
0810 14:35:09.176947 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:09.176963 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:09.177036 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:09.180379 (+ 3343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:09.180382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:09.180879 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:09.180982 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.180990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.185434 (+ 4444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.185437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.186278 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:09.186288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.187417 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.187423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:09.187499 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.188169 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:09.188187 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:09.189577 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:09.191659 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.191664 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.191666 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.191923 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.192246 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:09.192249 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:09.192251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:09.192387 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:09.192835 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:09.192838 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:09.192929 (+ 91us) client_negotiation.cc:769] Sending connection context
0810 14:35:09.193013 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 14:35:09.193164 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196}
I20260810 14:35:09.193964 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.176635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38308 (local address 127.1.206.124:38157)
0810 14:35:09.180155 (+ 3520us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.180160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.180172 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:35:09.180210 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.180213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.180251 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.184358 (+ 4107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.184471 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.185312 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.186948 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.187295 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.188918 (+ 1623us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.189717 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.189720 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.189722 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.189742 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.191542 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.192047 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.192053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.192055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.192139 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.192501 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.192504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.192506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.192731 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.193609 (+ 878us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.193685 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.193830 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3441}
I20260810 14:35:09.194198 26473 log.cc:824] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: Log is configured to *not* fsync() on all Append() calls
W20260810 14:35:09.194962 26571 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:09.195044 26571 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:35:09.196378 26560 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.196509 26560 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:09.197708 26473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: No bootstrap required, opened a new log
I20260810 14:35:09.197162 26321 master_runner.cc:186] Error getting master registration for 127.1.206.125:40365: OK, instance_id { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" instance_seqno: 1786372508920953 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:35:09.201330 26321 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:35:09.201889 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:35:09.201860 26473 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.202091 26473 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60ced62f90a3464d8f04820a923d676d, State: Initialized, Role: FOLLOWER
I20260810 14:35:09.202422 26473 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.202961 26553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: Bootstrap starting.
I20260810 14:35:09.203536 26364 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bdd0584a60c746d0b68dde2c4c0c5080"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49154
I20260810 14:35:09.203761 26473 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:09.203930 26364 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 14:35:09.204048 26364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:09.205885 26364 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.205960 26553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:09.206658 26553 log.cc:824] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:09.206897 26364 leader_election.cc:288] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [CANDIDATE]: Term 1 election: Requested vote from peers 60ced62f90a3464d8f04820a923d676d (127.1.206.125:40365), 2c7f5130da32457f8c8e4c1f1c7d5d41 (127.1.206.124:38157)
I20260810 14:35:09.207871 26574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.207998 26574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:09.207520 26446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "60ced62f90a3464d8f04820a923d676d"
I20260810 14:35:09.208200 26446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:09.210150 26446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdd0584a60c746d0b68dde2c4c0c5080 in term 1.
I20260810 14:35:09.210537 26338 leader_election.cc:302] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60ced62f90a3464d8f04820a923d676d, bdd0584a60c746d0b68dde2c4c0c5080; no voters:
I20260810 14:35:09.211045 26560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:35:09.211354 26560 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [term 1 LEADER]: Becoming Leader. State: Replica: bdd0584a60c746d0b68dde2c4c0c5080, State: Running, Role: LEADER
I20260810 14:35:09.211728 26560 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.213644 26560 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdd0584a60c746d0b68dde2c4c0c5080. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.213807 26560 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:09.214471 26596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:35:09.215714 26596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:35:09.218430 26553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: No bootstrap required, opened a new log
I20260810 14:35:09.220528 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.209594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55796 (local address 127.1.206.125:40365)
0810 14:35:09.209703 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.209708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.211162 (+ 1454us) server_negotiation.cc:407] Connection header received
0810 14:35:09.211378 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.211381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.211428 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.211479 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.212518 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.213223 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.214384 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.214699 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.214774 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.216758 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.216762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.216764 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.216789 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.218561 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.219078 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.219082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.219084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.219170 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.219510 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.219514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.219516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.219724 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.219836 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.220209 (+ 373us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.220363 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:35:09.213879 26402 master_runner.cc:186] Error getting master registration for 127.1.206.124:38157: OK, instance_id { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" instance_seqno: 1786372509140864 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:35:09.223029 26402 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 14:35:09.225008 26585 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:09.225096 26585 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:35:09.225170 26553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.225431 26553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c7f5130da32457f8c8e4c1f1c7d5d41, State: Initialized, Role: FOLLOWER
I20260810 14:35:09.225805 26553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } }
I20260810 14:35:09.227274 26553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:09.227334 26525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41"
I20260810 14:35:09.227545 26525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:09.229115 26525 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdd0584a60c746d0b68dde2c4c0c5080 in term 1.
I20260810 14:35:09.232810 26399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.210763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49168 (local address 127.1.206.126:36877)
0810 14:35:09.210905 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.210910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.214762 (+ 3852us) server_negotiation.cc:407] Connection header received
0810 14:35:09.215985 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.215989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.216036 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.216083 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.218618 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.219341 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.222191 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.222508 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.222612 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.226601 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.226607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.226612 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.226642 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.228364 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.228872 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.228876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.228878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.228963 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.231541 (+ 2578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.231545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.231547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.231780 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.231922 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.232522 (+ 600us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.232651 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260810 14:35:09.237761 26611 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:09.237855 26611 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:35:09.238034 26556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:09.210287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38322 (local address 127.1.206.124:38157)
0810 14:35:09.210426 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.210430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.217019 (+ 6589us) server_negotiation.cc:407] Connection header received
0810 14:35:09.217191 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.217194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.217241 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.217294 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.218149 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.218840 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.219924 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:09.220234 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:09.220350 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:09.229308 (+ 8958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:09.229312 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:09.229315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:09.229345 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:09.231027 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.233057 (+ 2030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.233061 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.233063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.233154 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:09.237023 (+ 3869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:09.237027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:09.237029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:09.237257 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:09.237400 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:09.237746 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 14:35:09.237876 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 14:35:09.243237 26446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [term 1 FOLLOWER]: Refusing update from remote peer bdd0584a60c746d0b68dde2c4c0c5080: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:35:09.243966 26525 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [term 1 FOLLOWER]: Refusing update from remote peer bdd0584a60c746d0b68dde2c4c0c5080: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:35:09.245505 26593 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:35:09.245988 26593 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:35:09.251502 26574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdd0584a60c746d0b68dde2c4c0c5080. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.251642 26574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:09.252743 26600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.252960 26600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:09.255393 26600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdd0584a60c746d0b68dde2c4c0c5080. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.255542 26600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:09.261966 26560 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.262099 26560 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:09.262219 26599 mvcc.cc:205] Tried to move back new op lower bound from 7316981797851426816 to 7316981797735415808. Current Snapshot: MvccSnapshot[applied={T|T < 7316981797851426816}]
I20260810 14:35:09.263615 26574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.263732 26574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:09.264295 26616 mvcc.cc:205] Tried to move back new op lower bound from 7316981797851426816 to 7316981797735415808. Current Snapshot: MvccSnapshot[applied={T|T < 7316981797851426816}]
I20260810 14:35:09.272359 26596 catalog_manager.cc:1347] Generated new cluster ID: 467da98894f447f4857200d91cfa0dd0
I20260810 14:35:09.272439 26596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:35:09.288249 26593 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.292907 26593 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:09.293229 26613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd0584a60c746d0b68dde2c4c0c5080" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 36877 } } peers { permanent_uuid: "60ced62f90a3464d8f04820a923d676d" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 40365 } } peers { permanent_uuid: "2c7f5130da32457f8c8e4c1f1c7d5d41" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38157 } } }
I20260810 14:35:09.293447 26613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:09.293622 26614 mvcc.cc:205] Tried to move back new op lower bound from 7316981797851426816 to 7316981797735415808. Current Snapshot: MvccSnapshot[applied={T|T < 7316981797851426816}]
I20260810 14:35:09.331220 26596 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:35:09.332589 26596 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:35:09.354672 26596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdd0584a60c746d0b68dde2c4c0c5080: Generated new TSK 0
I20260810 14:35:09.355525 26596 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:35:09.395525 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.392775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55810 (local address 127.1.206.125:40365)
0810 14:35:09.392906 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.392911 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.394288 (+ 1377us) server_negotiation.cc:407] Connection header received
0810 14:35:09.394526 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.394530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.394590 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.394683 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.395382 (+ 699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55810: BlockingRecv error: recv got EOF from 127.0.0.1:55810 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 14:35:09.397092 26556 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.393539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.1.206.124:38157)
0810 14:35:09.393670 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.393675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.396081 (+ 2406us) server_negotiation.cc:407] Connection header received
0810 14:35:09.396194 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.396197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.396288 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.396392 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.396961 (+ 569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38332: BlockingRecv error: recv got EOF from 127.0.0.1:38332 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 14:35:09.397451 26399 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.393958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49184 (local address 127.1.206.126:36877)
0810 14:35:09.394073 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.394078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.396409 (+ 2331us) server_negotiation.cc:407] Connection header received
0810 14:35:09.396599 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.396603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.396674 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.396732 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.397314 (+ 582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49184: BlockingRecv error: recv got EOF from 127.0.0.1:49184 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260810 14:35:09.402714 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.401062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55822 (local address 127.1.206.125:40365)
0810 14:35:09.401177 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.401182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.401656 (+ 474us) server_negotiation.cc:407] Connection header received
0810 14:35:09.401902 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.401906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.401988 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.402046 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.402593 (+ 547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55822: BlockingRecv error: recv got EOF from 127.0.0.1:55822 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 14:35:09.408228 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.406562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55830 (local address 127.1.206.125:40365)
0810 14:35:09.406680 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.406684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.407209 (+ 525us) server_negotiation.cc:407] Connection header received
0810 14:35:09.407425 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.407428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.407482 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.407538 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.408115 (+ 577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55830: BlockingRecv error: recv got EOF from 127.0.0.1:55830 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 14:35:09.414271 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.412782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55836 (local address 127.1.206.125:40365)
0810 14:35:09.412886 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.412891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.413376 (+ 485us) server_negotiation.cc:407] Connection header received
0810 14:35:09.413557 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.413560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.413607 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.413667 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.414161 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55836: BlockingRecv error: recv got EOF from 127.0.0.1:55836 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 14:35:09.422456 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.420744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55840 (local address 127.1.206.125:40365)
0810 14:35:09.420897 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.420902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.421458 (+ 556us) server_negotiation.cc:407] Connection header received
0810 14:35:09.421682 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.421686 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.421739 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.421792 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.422337 (+ 545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55840: BlockingRecv error: recv got EOF from 127.0.0.1:55840 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 14:35:09.434312 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.432929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55852 (local address 127.1.206.125:40365)
0810 14:35:09.433055 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.433062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.433373 (+ 311us) server_negotiation.cc:407] Connection header received
0810 14:35:09.433486 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.433489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.433552 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.433648 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.434140 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55852: BlockingRecv error: recv got EOF from 127.0.0.1:55852 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260810 14:35:09.453774 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.452568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55866 (local address 127.1.206.125:40365)
0810 14:35:09.452727 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.452732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.452940 (+ 208us) server_negotiation.cc:407] Connection header received
0810 14:35:09.453050 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.453053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.453112 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.453207 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.453651 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55866: BlockingRecv error: recv got EOF from 127.0.0.1:55866 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 14:35:09.489660 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.488303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55870 (local address 127.1.206.125:40365)
0810 14:35:09.488481 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.488486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.488661 (+ 175us) server_negotiation.cc:407] Connection header received
0810 14:35:09.488853 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.488856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.488925 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.489028 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.489514 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55870: BlockingRecv error: recv got EOF from 127.0.0.1:55870 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260810 14:35:09.557439 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.556153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55882 (local address 127.1.206.125:40365)
0810 14:35:09.556332 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.556338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.556490 (+ 152us) server_negotiation.cc:407] Connection header received
0810 14:35:09.556675 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.556680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.556733 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.556835 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.557323 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55882: BlockingRecv error: recv got EOF from 127.0.0.1:55882 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260810 14:35:09.689107 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.687721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55896 (local address 127.1.206.125:40365)
0810 14:35:09.687873 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.687878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.688079 (+ 201us) server_negotiation.cc:407] Connection header received
0810 14:35:09.688297 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.688303 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.688367 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.688463 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.688992 (+ 529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55896: BlockingRecv error: recv got EOF from 127.0.0.1:55896 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 14:35:09.948383 26476 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:09.947349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55912 (local address 127.1.206.125:40365)
0810 14:35:09.947482 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:09.947486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:09.947503 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:35:09.947651 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:09.947653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:09.947702 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:09.947790 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:09.948211 (+ 421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55912: BlockingRecv error: recv got EOF from 127.0.0.1:55912 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 14:35:10.227034 26585 catalog_manager.cc:1259] Loaded cluster ID: 467da98894f447f4857200d91cfa0dd0
I20260810 14:35:10.227146 26585 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: loading cluster ID for follower catalog manager: success
I20260810 14:35:10.229955 26585 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: acquiring CA information for follower catalog manager: success
I20260810 14:35:10.231170 26585 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 60ced62f90a3464d8f04820a923d676d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:35:10.239174 26611 catalog_manager.cc:1259] Loaded cluster ID: 467da98894f447f4857200d91cfa0dd0
I20260810 14:35:10.239262 26611 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: loading cluster ID for follower catalog manager: success
I20260810 14:35:10.240947 26611 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: acquiring CA information for follower catalog manager: success
I20260810 14:35:10.242062 26611 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2c7f5130da32457f8c8e4c1f1c7d5d41: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:35:10.467026 26693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:10.462799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.1.206.125:40365)
0810 14:35:10.463077 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:10.463084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:10.463105 (+ 21us) server_negotiation.cc:407] Connection header received
0810 14:35:10.463175 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:10.463177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:10.463305 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:10.463451 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:10.463748 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.464380 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.465332 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.465590 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.465710 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:10.466102 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:10.466565 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:10.466718 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:10.466784 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 14:35:10.466859 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":69,"threads_started":1}
I20260810 14:35:10.474305 26702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:10.470448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38334 (local address 127.1.206.124:38157)
0810 14:35:10.470681 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:10.470685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:10.470699 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:35:10.470818 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:10.470820 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:10.470936 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:10.471037 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:10.471241 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.471756 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.472774 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.473011 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.473144 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:10.473381 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:10.473836 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:10.473939 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:10.474006 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 14:35:10.474059 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":89,"threads_started":1}
I20260810 14:35:10.482543 26693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:10.477817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55928 (local address 127.1.206.125:40365)
0810 14:35:10.477962 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:10.477968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:10.478407 (+ 439us) server_negotiation.cc:407] Connection header received
0810 14:35:10.478721 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:10.478724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:10.478806 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:10.478913 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:10.479158 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.479938 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.481039 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.481376 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.481498 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:10.481925 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:10.482023 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:10.482102 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:10.482320 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 14:35:10.482387 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 14:35:10.482709 26702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:10.478284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38336 (local address 127.1.206.124:38157)
0810 14:35:10.478401 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:10.478406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:10.478446 (+ 40us) server_negotiation.cc:407] Connection header received
0810 14:35:10.478610 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:10.478613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:10.478686 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:10.478758 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:10.479047 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.479871 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.481127 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.481465 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.481569 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:10.482187 (+ 618us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:10.482272 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:10.482353 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:10.482520 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 14:35:10.482584 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 14:35:10.483309 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:10.477757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49200 (local address 127.1.206.126:36877)
0810 14:35:10.478129 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:10.478136 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:10.478155 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:35:10.478395 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:10.478400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:10.478588 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:10.478712 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:10.479212 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.479733 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.481599 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:10.481892 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:10.481996 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:10.482314 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:10.482863 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:10.482965 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:10.483091 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 14:35:10.483161 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":91,"threads_started":1}
I20260810 14:35:10.486980 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26321
I20260810 14:35:10.496994 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26402
I20260810 14:35:10.505653 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26480
2026-08-10T14:35:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3237 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:35:10 dist-test-slave-0b58 krb5kdc[26714](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:35:10 dist-test-slave-0b58 krb5kdc[26714](info): set up 2 sockets
Aug 10 14:35:10 dist-test-slave-0b58 krb5kdc[26714](info): commencing operation
krb5kdc: starting...
W20260810 14:35:11.635633 1849 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/test-user.keytab.
Aug 10 14:35:11 dist-test-slave-0b58 krb5kdc[26714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:35:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:35:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.206.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
Entry for principal kudu/127.1.206.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab.
I20260810 14:35:11.765452 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:35569
--webserver_interface=127.1.206.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:33297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:35569,127.1.206.125:35121,127.1.206.124:38861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:35:11.882198 26729 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:35:11.882561 26729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:11.882642 26729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:11.882725 26729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:11.886797 26729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:11.886904 26729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:11.886941 26729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:11.886983 26729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:11.887018 26729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:11.892458 26729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:33297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:35569,127.1.206.125:35121,127.1.206.124:38861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.126.keytab
--principal=kudu/127.1.206.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.126:35569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.206.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:11.893659 26729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:11.894951 26729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:11.903975 26737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:11.904034 26729 server_base.cc:1034] running on GCE node
W20260810 14:35:11.904053 26735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:11.904167 26734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:11.904944 26729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:11.906131 26729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:11.907327 26729 hybrid_clock.cc:648] HybridClock initialized: now 1786372511907298 us; error 40 us; skew 500 ppm
Aug 10 14:35:11 dist-test-slave-0b58 krb5kdc[26714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:11.910404 26729 init.cc:377] Logged in from keytab as kudu/127.1.206.126@KRBTEST.COM (short username kudu)
I20260810 14:35:11.911417 26729 webserver.cc:460] Webserver started at http://127.1.206.126:46013/ using document root <none> and password file <none>
I20260810 14:35:11.912014 26729 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:11.912081 26729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:11.912344 26729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:11.914470 26729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data/instance:
uuid: "be1a4846199340c39358a0f3ffe209b8"
format_stamp: "Formatted at 2026-08-10 14:35:11 on dist-test-slave-0b58"
server_key: "83831b5221da767b3d3487daeb3df868"
server_key_iv: "3cf4d6252ef5f091227e80f092496e99"
server_key_version: "encryptionkey@0"
I20260810 14:35:11.915060 26729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/wal/instance:
uuid: "be1a4846199340c39358a0f3ffe209b8"
format_stamp: "Formatted at 2026-08-10 14:35:11 on dist-test-slave-0b58"
server_key: "83831b5221da767b3d3487daeb3df868"
server_key_iv: "3cf4d6252ef5f091227e80f092496e99"
server_key_version: "encryptionkey@0"
I20260810 14:35:11.918846 26729 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260810 14:35:11.921295 26744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:11.922520 26729 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:35:11.922669 26729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/wal
uuid: "be1a4846199340c39358a0f3ffe209b8"
format_stamp: "Formatted at 2026-08-10 14:35:11 on dist-test-slave-0b58"
server_key: "83831b5221da767b3d3487daeb3df868"
server_key_iv: "3cf4d6252ef5f091227e80f092496e99"
server_key_version: "encryptionkey@0"
I20260810 14:35:11.922784 26729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:11.946959 26729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:11.950054 26729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:11.950294 26729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:11.958040 26729 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.126:35569
I20260810 14:35:11.958400 26802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.126:35569 every 8 connection(s)
I20260810 14:35:11.959344 26729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/data/info.pb
I20260810 14:35:11.962170 26803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:11.963204 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26729
I20260810 14:35:11.963373 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-0/wal/instance
I20260810 14:35:11.963675 1849 external_mini_cluster.cc:1428] Setting key a9a931780bf05c51171eadf0c117d242
I20260810 14:35:11.966216 26803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.206.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.125@KRBTEST.COM" created.
Aug 10 14:35:11 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:11.981958 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:11.968842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43320 (local address 127.1.206.126:35569)
0810 14:35:11.969274 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:11.969306 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:11.969575 (+ 269us) server_negotiation.cc:407] Connection header received
0810 14:35:11.970607 (+ 1032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:11.970612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:11.970796 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:11.970984 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:11.971844 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:11.972857 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:11.973986 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:11.974367 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:11.974592 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:11.977214 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:11.977220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:11.977230 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:11.977251 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:11.978825 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:11.979304 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:11.979320 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:11.979321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:11.979422 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:11.979745 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:11.979750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:11.979752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:11.980112 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:11.980254 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:11.980664 (+ 410us) server_negotiation.cc:299] Negotiation successful
0810 14:35:11.980918 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":283,"thread_start_us":152,"threads_started":1}
I20260810 14:35:11.981958 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:11.968843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:35569 (local address 127.0.0.1:43320)
0810 14:35:11.969431 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:11.969469 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:11.970298 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:11.970984 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:11.970989 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:11.971452 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:11.971690 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:11.971704 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:11.972981 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:11.972985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:11.973862 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:11.973873 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:11.974529 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:11.974532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:11.974645 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:11.975420 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:11.975446 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:11.977056 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:11.978939 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:11.978950 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:11.978960 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:11.979190 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:11.979531 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:11.979534 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:11.979536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:11.979651 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:11.980238 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:11.980244 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:11.980426 (+ 182us) client_negotiation.cc:769] Sending connection context
0810 14:35:11.980600 (+ 174us) client_negotiation.cc:240] Negotiation successful
0810 14:35:11.980970 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":141,"spinlock_wait_cycles":20096,"thread_start_us":159,"threads_started":1}
I20260810 14:35:11.984954 26803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:11.985749 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:11.985473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41788)
0810 14:35:11.985601 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:11.985677 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 14:35:11.985958 26749 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
I20260810 14:35:11.986900 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:11.986639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41796)
0810 14:35:11.986749 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:11.986825 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 14:35:11.987046 26803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:35121: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab.
Entry for principal kudu/127.1.206.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab.
I20260810 14:35:11.992028 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:35121
--webserver_interface=127.1.206.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab
--principal=kudu/127.1.206.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:33297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:35569,127.1.206.125:35121,127.1.206.124:38861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:35:12.036345 26803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } attempt: 1
I20260810 14:35:12.037226 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.036916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41804)
0810 14:35:12.037075 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.037146 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260810 14:35:12.038034 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.037820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41808)
0810 14:35:12.037927 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.037972 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 14:35:12.038251 26803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:35121: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
I20260810 14:35:12.106426 26803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } attempt: 2
I20260810 14:35:12.107326 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.107012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41820)
0810 14:35:12.107174 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.107242 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 14:35:12.108083 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.107830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41832)
0810 14:35:12.107920 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.108006 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 14:35:12.108223 26803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.125:35121: Network error: Client connection negotiation failed: client connection to 127.1.206.125:35121: connect: Connection refused (error 111)
W20260810 14:35:12.108721 26811 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:35:12.109030 26811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:12.109077 26811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:12.109163 26811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:35:12.113401 26811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:12.113463 26811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:12.113483 26811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:12.113540 26811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:12.113577 26811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:12.119040 26811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:33297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:35569,127.1.206.125:35121,127.1.206.124:38861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.125.keytab
--principal=kudu/127.1.206.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.125:35121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.206.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:12.120175 26811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:12.121250 26811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:12.130120 26821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:12.130110 26817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:12.130088 26818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:12.130329 26811 server_base.cc:1034] running on GCE node
I20260810 14:35:12.131073 26811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:12.132302 26811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:12.133491 26811 hybrid_clock.cc:648] HybridClock initialized: now 1786372512133468 us; error 36 us; skew 500 ppm
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:12.136510 26811 init.cc:377] Logged in from keytab as kudu/127.1.206.125@KRBTEST.COM (short username kudu)
I20260810 14:35:12.137547 26811 webserver.cc:460] Webserver started at http://127.1.206.125:40639/ using document root <none> and password file <none>
I20260810 14:35:12.138144 26811 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:12.138217 26811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:12.138481 26811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:12.140725 26811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data/instance:
uuid: "9f5b128dc22e47feafa360ad7781e8d6"
format_stamp: "Formatted at 2026-08-10 14:35:12 on dist-test-slave-0b58"
server_key: "30f3c6773fc21d70b77c98c44aa1cef2"
server_key_iv: "3775e57ceb57b1be66e2739e8ad69276"
server_key_version: "encryptionkey@0"
I20260810 14:35:12.141331 26811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/wal/instance:
uuid: "9f5b128dc22e47feafa360ad7781e8d6"
format_stamp: "Formatted at 2026-08-10 14:35:12 on dist-test-slave-0b58"
server_key: "30f3c6773fc21d70b77c98c44aa1cef2"
server_key_iv: "3775e57ceb57b1be66e2739e8ad69276"
server_key_version: "encryptionkey@0"
I20260810 14:35:12.145375 26811 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 14:35:12.147965 26828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:12.149387 26811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 14:35:12.149530 26811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/wal
uuid: "9f5b128dc22e47feafa360ad7781e8d6"
format_stamp: "Formatted at 2026-08-10 14:35:12 on dist-test-slave-0b58"
server_key: "30f3c6773fc21d70b77c98c44aa1cef2"
server_key_iv: "3775e57ceb57b1be66e2739e8ad69276"
server_key_version: "encryptionkey@0"
I20260810 14:35:12.149652 26811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:12.168129 26811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:12.171737 26811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:12.171962 26811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:12.179072 26811 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.125:35121
I20260810 14:35:12.179423 26883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.125:35121 every 8 connection(s)
I20260810 14:35:12.180104 26811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/data/info.pb
I20260810 14:35:12.182916 26884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:12.186851 26884 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:12.189498 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26811
I20260810 14:35:12.189638 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-1/wal/instance
I20260810 14:35:12.189967 1849 external_mini_cluster.cc:1428] Setting key 1ad9ec5d15e8375a9d56b2ee608be4d8
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.206.124@KRBTEST.COM; defaulting to no policy
I20260810 14:35:12.199429 26803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.206.124@KRBTEST.COM" created.
I20260810 14:35:12.202975 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.188713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43324 (local address 127.1.206.126:35569)
0810 14:35:12.188877 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.188882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.189886 (+ 1004us) server_negotiation.cc:407] Connection header received
0810 14:35:12.190873 (+ 987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.190877 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.190941 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.191049 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.192229 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.192856 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.194081 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.194339 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.194462 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.197333 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.197340 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.197343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.197378 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.199877 (+ 2499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.200564 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.200567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.200568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.200646 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.201052 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.201056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.201057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.201354 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.201460 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.202674 (+ 1214us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.202803 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":57}
I20260810 14:35:12.204139 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.189132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:35569 (local address 127.0.0.1:43324)
0810 14:35:12.189716 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.189783 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.190662 (+ 879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.191247 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.191254 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.191607 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.192071 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.192084 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.193013 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.193016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.193937 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.193947 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.194522 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.194527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.194721 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.195361 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.195378 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.197122 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.200022 (+ 2900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.200028 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.200044 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.200458 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.200760 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.200763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.200765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.200952 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.201989 (+ 1037us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.201999 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.202373 (+ 374us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.202604 (+ 231us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.202984 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":150,"threads_started":1}
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
I20260810 14:35:12.205777 26884 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:12.210220 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.199962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41848)
0810 14:35:12.200096 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.200112 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.200192 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.200946 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.200949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.201143 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.201329 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.201338 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.202417 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.202424 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.203207 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.203220 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.203992 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.203996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.204109 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.204736 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.204754 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.206238 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.208528 (+ 2290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.208531 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.208533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.208779 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.209120 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.209126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.209130 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.209224 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.209668 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.209671 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.209772 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.209896 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.210039 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":1}
I20260810 14:35:12.210347 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.200071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41848 (local address 127.1.206.125:35121)
0810 14:35:12.200448 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.200461 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.200489 (+ 28us) server_negotiation.cc:407] Connection header received
0810 14:35:12.200539 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.200546 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.200780 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.200927 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.201469 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.202291 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.203353 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.203854 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.203975 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.206383 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.206392 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.206405 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.206431 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.208398 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.208927 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.208932 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.208934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.209013 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.209331 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.209334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.209335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.209556 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.209701 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.209997 (+ 296us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.210166 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":251,"thread_start_us":107,"threads_started":1}
I20260810 14:35:12.212608 26803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:12.213370 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.213079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45680)
0810 14:35:12.213232 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.213291 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 14:35:12.214075 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.213831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45688)
0810 14:35:12.213968 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.214014 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
W20260810 14:35:12.214425 26803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38861: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
I20260810 14:35:12.217752 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.206387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41850)
0810 14:35:12.206502 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.206518 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.206589 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.207671 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.207677 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.207939 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.208068 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.208078 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.209213 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.209218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.210134 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.210146 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.211368 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.211373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.211466 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.211947 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.211965 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.214768 (+ 2803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.216316 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.216321 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.216323 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.216514 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.216794 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.216798 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.216800 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.216883 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.217246 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.217249 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.217333 (+ 84us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.217440 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.217584 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":28}
I20260810 14:35:12.217803 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.206647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41850 (local address 127.1.206.125:35121)
0810 14:35:12.207144 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.207153 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.207170 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:35:12.207203 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.207206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.207253 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.207364 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.208213 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.209091 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.210774 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.211195 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.211334 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.214923 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.214926 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.214928 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.214947 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.216189 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.216613 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.216618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.216620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.216697 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.216979 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.216982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.216984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.217150 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.217254 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.217496 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.217644 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":408,"thread_start_us":190,"threads_started":1}
I20260810 14:35:12.218519 26884 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.206.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab.
Entry for principal kudu/127.1.206.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab.
I20260810 14:35:12.219241 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.218993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45700)
0810 14:35:12.219111 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.219180 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 14:35:12.219436 26832 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
I20260810 14:35:12.219664 1849 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskN56qvq/build/debug/bin/kudu
/tmp/dist-test-taskN56qvq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:38861
--webserver_interface=127.1.206.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab
--principal=kudu/127.1.206.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.206.84:33297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.206.126:35569,127.1.206.125:35121,127.1.206.124:38861
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:35:12.220584 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.220377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45716)
0810 14:35:12.220483 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.220528 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 14:35:12.221463 26884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38861: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
I20260810 14:35:12.245628 26803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } attempt: 1
I20260810 14:35:12.246536 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.246206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45722)
0810 14:35:12.246381 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.246451 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 14:35:12.247306 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.247089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45732)
0810 14:35:12.247194 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.247248 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 14:35:12.247475 26803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38861: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
I20260810 14:35:12.270756 26884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } attempt: 1
I20260810 14:35:12.271711 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.271400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45742)
0810 14:35:12.271560 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.271628 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 14:35:12.272511 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.272230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45752)
0810 14:35:12.272405 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.272453 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260810 14:35:12.272650 26884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38861: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
I20260810 14:35:12.322674 26803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } attempt: 2
I20260810 14:35:12.323541 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.323231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45762)
0810 14:35:12.323384 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.323460 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260810 14:35:12.324391 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.324082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45776)
0810 14:35:12.324231 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.324319 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 14:35:12.324527 26803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38861: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
W20260810 14:35:12.337112 26892 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:35:12.337450 26892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:35:12.337518 26892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:35:12.337600 26892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 14:35:12.340798 26884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } attempt: 2
I20260810 14:35:12.341609 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.341317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45782)
0810 14:35:12.341462 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.341533 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 14:35:12.341848 26892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:35:12.341923 26892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:35:12.341972 26892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:35:12.342031 26892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:35:12.342072 26892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:35:12.342430 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.342212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45790)
0810 14:35:12.342324 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.342375 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 14:35:12.342564 26884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.206.124:38861: Network error: Client connection negotiation failed: client connection to 127.1.206.124:38861: connect: Connection refused (error 111)
I20260810 14:35:12.347656 26892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.206.84:33297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.206.126:35569,127.1.206.125:35121,127.1.206.124:38861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/krb5kdc/kudu_127.1.206.124.keytab
--principal=kudu/127.1.206.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.206.124:38861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.206.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 13:59:06 UTC on ccycloud.quasar-wwztxk.root.comops.site
build id 4577958
I20260810 14:35:12.348830 26892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:35:12.349877 26892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:35:12.358505 26899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:35:12.358511 26900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:12.358563 26892 server_base.cc:1034] running on GCE node
W20260810 14:35:12.358511 26902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:35:12.359295 26892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:35:12.360385 26892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:35:12.361568 26892 hybrid_clock.cc:648] HybridClock initialized: now 1786372512361555 us; error 26 us; skew 500 ppm
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:35:12.364400 26892 init.cc:377] Logged in from keytab as kudu/127.1.206.124@KRBTEST.COM (short username kudu)
I20260810 14:35:12.365258 26892 webserver.cc:460] Webserver started at http://127.1.206.124:39915/ using document root <none> and password file <none>
I20260810 14:35:12.365826 26892 fs_manager.cc:359] Metadata directory not provided
I20260810 14:35:12.365921 26892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:35:12.366168 26892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:35:12.368212 26892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data/instance:
uuid: "5758e766b9f946b89c2b03c20b93e143"
format_stamp: "Formatted at 2026-08-10 14:35:12 on dist-test-slave-0b58"
server_key: "80377f1cfc20dbb93553ff7e648829c0"
server_key_iv: "c9195c9b990511b9214716b39adb0939"
server_key_version: "encryptionkey@0"
I20260810 14:35:12.368853 26892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/wal/instance:
uuid: "5758e766b9f946b89c2b03c20b93e143"
format_stamp: "Formatted at 2026-08-10 14:35:12 on dist-test-slave-0b58"
server_key: "80377f1cfc20dbb93553ff7e648829c0"
server_key_iv: "c9195c9b990511b9214716b39adb0939"
server_key_version: "encryptionkey@0"
I20260810 14:35:12.372495 26892 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 14:35:12.374912 26909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:35:12.376080 26892 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 14:35:12.376219 26892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data,/tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/wal
uuid: "5758e766b9f946b89c2b03c20b93e143"
format_stamp: "Formatted at 2026-08-10 14:35:12 on dist-test-slave-0b58"
server_key: "80377f1cfc20dbb93553ff7e648829c0"
server_key_iv: "c9195c9b990511b9214716b39adb0939"
server_key_version: "encryptionkey@0"
I20260810 14:35:12.376389 26892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:35:12.392628 26892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:35:12.396113 26892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:35:12.396395 26892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:35:12.403704 26892 rpc_server.cc:307] RPC server started. Bound to: 127.1.206.124:38861
I20260810 14:35:12.404031 26964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.206.124:38861 every 8 connection(s)
I20260810 14:35:12.404788 26892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/data/info.pb
I20260810 14:35:12.407665 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:35:12.407871 1849 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskN56qvq/build/debug/bin/kudu as pid 26892
I20260810 14:35:12.408047 1849 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskN56qvq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786372219863018-1849-0/minicluster-data/master-2/wal/instance
I20260810 14:35:12.408460 1849 external_mini_cluster.cc:1428] Setting key aa1d5536d60af1931f79d5544ea203ea
I20260810 14:35:12.412786 26965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:12.423688 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.409829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45792 (local address 127.1.206.124:38861)
0810 14:35:12.410248 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.410264 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.410301 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:35:12.411017 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.411035 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.411372 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.411786 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.412720 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.413784 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.414875 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.415522 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.415684 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.418202 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.418209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.418218 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.418245 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.420165 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.420641 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.420651 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.420656 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.420825 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.421173 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.421178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.421180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.421766 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.422003 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.422235 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.422578 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":129,"threads_started":1}
I20260810 14:35:12.423703 26803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } attempt: 3
I20260810 14:35:12.424077 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.414548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.126:35569 (local address 127.0.0.1:43338)
0810 14:35:12.414973 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.415024 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.415146 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.415439 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.415443 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.415764 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.415893 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.415899 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.416693 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.416696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.417306 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.417323 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.417885 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.417892 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.417983 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.418541 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.418558 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.420300 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.422264 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.422274 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.422280 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.422631 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.422927 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.422929 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.422930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.423005 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.423437 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.423442 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.423536 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.423647 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.423867 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":184,"threads_started":1}
I20260810 14:35:12.425351 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.414636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43338 (local address 127.1.206.126:35569)
0810 14:35:12.414797 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.414804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.415115 (+ 311us) server_negotiation.cc:407] Connection header received
0810 14:35:12.415240 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.415243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.415302 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.415388 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.416024 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.416570 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.417460 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.417667 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.417774 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.420457 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.420461 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.420463 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.420486 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.422137 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.422732 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.422736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.422738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.422833 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.423090 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.423093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.423094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.423346 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.423447 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.423764 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.425204 (+ 1440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 14:35:12.426307 26965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.126@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.126@KRBTEST.COM
I20260810 14:35:12.433779 26884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } attempt: 3
I20260810 14:35:12.434666 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.424106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45796)
0810 14:35:12.424401 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.424416 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.424496 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.424934 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.424936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.425133 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.425230 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.425237 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.426298 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.426301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.427010 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.427020 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.427612 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.427616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.427737 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.429205 (+ 1468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.429223 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.430538 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.432893 (+ 2355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.432897 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.432899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.433159 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.433485 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.433491 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.433496 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.433592 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.434158 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.434161 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.434264 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.434380 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.434509 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":19}
I20260810 14:35:12.435151 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.424605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45796 (local address 127.1.206.124:38861)
0810 14:35:12.424727 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.424731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.424744 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:35:12.424775 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.424778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.424823 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.424906 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.425384 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.426138 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.427132 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.427496 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.427604 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.430663 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.430667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.430669 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.430692 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.432751 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.433265 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.433272 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.433276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.433376 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.433727 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.433731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.433732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.434035 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.434161 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.434431 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.434999 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 14:35:12.436939 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.426848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.125:35121 (local address 127.0.0.1:41864)
0810 14:35:12.427319 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.427332 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.427406 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.427828 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.427832 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.428012 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.428095 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.428121 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.429163 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.429165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.429972 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.429983 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.430796 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.430800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.430921 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.431495 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.431510 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.433072 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.435107 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.435110 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.435112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.435370 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.435701 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.435704 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.435706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.435795 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.436388 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.436391 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.436561 (+ 170us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.436669 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.436794 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":44}
I20260810 14:35:12.437448 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.427007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41864 (local address 127.1.206.125:35121)
0810 14:35:12.427162 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.427167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.427383 (+ 216us) server_negotiation.cc:407] Connection header received
0810 14:35:12.427554 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.427560 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.427618 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.427676 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.428220 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.429052 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.430147 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.430532 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.430641 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.433235 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.433240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.433245 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.433284 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.435035 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.435495 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.435499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.435502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.435601 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.435951 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.435955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.435956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.436180 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.436337 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.437162 (+ 825us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.437281 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 14:35:12.439123 26803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8: Bootstrap starting.
I20260810 14:35:12.439323 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.427129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43350 (local address 127.1.206.126:35569)
0810 14:35:12.427226 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.427230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.427327 (+ 97us) server_negotiation.cc:407] Connection header received
0810 14:35:12.427470 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.427474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.427518 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.427593 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.428479 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.429173 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.430300 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.430552 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.430656 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.433863 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.433869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.433874 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.433900 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.437131 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.437616 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.437620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.437622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.437712 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.438053 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.438060 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.438061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.438267 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.438470 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.438982 (+ 512us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.439122 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":42}
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.125@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
I20260810 14:35:12.440971 26965 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:35:12.443563 26803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:12.444753 26803 log.cc:824] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:12.445025 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.434645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45810)
0810 14:35:12.434826 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.434841 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.434918 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.435899 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.435902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.436044 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.436120 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.436125 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.437383 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.437386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.437973 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.437982 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.438629 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.438632 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.438717 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.439158 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.439173 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.440698 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.443443 (+ 2745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.443447 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.443449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.443690 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.444000 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.444006 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.444011 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.444103 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.444533 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.444536 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.444629 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.444711 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.444865 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260810 14:35:12.445603 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.434598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45810 (local address 127.1.206.124:38861)
0810 14:35:12.435036 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.435044 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.435057 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:35:12.435721 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.435725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.435767 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.436302 (+ 535us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.436408 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.437260 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.438146 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.438510 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.438615 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.440864 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.440869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.440871 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.440894 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.443327 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.443818 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.443821 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.443823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.443900 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.444202 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.444206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.444207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.444426 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.445200 (+ 774us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.445275 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.445388 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":378,"thread_start_us":111,"threads_started":1}
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372512, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.206.124@KRBTEST.COM for kudu/127.1.206.124@KRBTEST.COM
Aug 10 14:35:12 dist-test-slave-0b58 krb5kdc[26714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786372511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.206.125@KRBTEST.COM
I20260810 14:35:12.448173 26803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8: No bootstrap required, opened a new log
I20260810 14:35:12.449090 26884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: Bootstrap starting.
I20260810 14:35:12.449672 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.441447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.206.124:38861 (local address 127.0.0.1:45812)
0810 14:35:12.441598 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 14:35:12.441610 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:35:12.441684 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:35:12.441903 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:35:12.441909 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:35:12.442102 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:35:12.442170 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.442175 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.443168 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.443171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.443974 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:35:12.443984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.444609 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.444612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:35:12.444689 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.445099 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:35:12.445113 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:35:12.446466 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:35:12.448238 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.448243 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.448244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.448494 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.448759 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:35:12.448761 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:35:12.448763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:35:12.448839 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:35:12.449241 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:35:12.449244 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:35:12.449330 (+ 86us) client_negotiation.cc:769] Sending connection context
0810 14:35:12.449424 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 14:35:12.449540 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260810 14:35:12.450068 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.441475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45812 (local address 127.1.206.124:38861)
0810 14:35:12.441568 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.441571 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.441650 (+ 79us) server_negotiation.cc:407] Connection header received
0810 14:35:12.441750 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.441753 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.441798 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.442009 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.442280 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.443044 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.444085 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.444412 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.444521 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.446584 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.446588 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.446590 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.446611 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.448131 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.448598 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.448600 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.448602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.448672 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.448925 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.448927 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.448929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.449104 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.449207 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.449852 (+ 645us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.449951 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 14:35:12.451942 26884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:12.452148 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.440465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41868 (local address 127.1.206.125:35121)
0810 14:35:12.440775 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.440782 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.440798 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:35:12.440965 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.440968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.441009 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.441056 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.442186 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.443128 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.444221 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.444546 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.444634 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.448365 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.448368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.448371 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.448396 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.450073 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.450591 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.450596 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.450600 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.450695 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.451010 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.451014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.451016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.451221 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.451384 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.451750 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.451895 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260810 14:35:12.452872 26884 log.cc:824] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:12.452908 26965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: Bootstrap starting.
I20260810 14:35:12.455157 26965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: Neither blocks nor log segments found. Creating new log.
I20260810 14:35:12.455281 26884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: No bootstrap required, opened a new log
I20260810 14:35:12.453977 26803 raft_consensus.cc:348] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
I20260810 14:35:12.455686 26803 raft_consensus.cc:729] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be1a4846199340c39358a0f3ffe209b8, State: Initialized, Role: FOLLOWER
I20260810 14:35:12.455965 1849 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:35:12.455968 26965 log.cc:824] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: Log is configured to *not* fsync() on all Append() calls
I20260810 14:35:12.456131 26803 consensus_queue.cc:260] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
I20260810 14:35:12.456769 26975 sys_catalog.cc:455] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.456921 26975 sys_catalog.cc:458] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:12.457265 26773 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "be1a4846199340c39358a0f3ffe209b8"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43350
I20260810 14:35:12.457960 26803 sys_catalog.cc:564] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:12.458020 26773 raft_consensus.cc:482] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 14:35:12.458148 26773 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:12.458578 26965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: No bootstrap required, opened a new log
I20260810 14:35:12.459280 26884 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
I20260810 14:35:12.459411 26773 raft_consensus.cc:504] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
I20260810 14:35:12.459502 26884 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5b128dc22e47feafa360ad7781e8d6, State: Initialized, Role: FOLLOWER
I20260810 14:35:12.459837 26884 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
I20260810 14:35:12.460239 26773 leader_election.cc:288] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [CANDIDATE]: Term 1 election: Requested vote from peers 9f5b128dc22e47feafa360ad7781e8d6 (127.1.206.125:35121), 5758e766b9f946b89c2b03c20b93e143 (127.1.206.124:38861)
I20260810 14:35:12.461367 26884 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:12.462503 26965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
I20260810 14:35:12.462738 26965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5758e766b9f946b89c2b03c20b93e143, State: Initialized, Role: FOLLOWER
I20260810 14:35:12.463047 26965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
I20260810 14:35:12.463096 26857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "be1a4846199340c39358a0f3ffe209b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9f5b128dc22e47feafa360ad7781e8d6"
I20260810 14:35:12.463321 26857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:12.464370 26965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:35:12.464764 26857 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be1a4846199340c39358a0f3ffe209b8 in term 1.
I20260810 14:35:12.465281 26938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "be1a4846199340c39358a0f3ffe209b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5758e766b9f946b89c2b03c20b93e143"
I20260810 14:35:12.465519 26938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:35:12.466884 26938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be1a4846199340c39358a0f3ffe209b8 in term 1.
I20260810 14:35:12.467255 26749 leader_election.cc:302] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5758e766b9f946b89c2b03c20b93e143, be1a4846199340c39358a0f3ffe209b8; no voters:
W20260810 14:35:12.467424 26990 catalog_manager.cc:1558] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:12.467480 26990 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:35:12.463738 26729 master_runner.cc:186] Error getting master registration for 127.1.206.125:35121: OK, instance_id { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" instance_seqno: 1786372512177123 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:35:12.468696 26729 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:35:12.468858 26975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:35:12.469115 26975 raft_consensus.cc:686] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [term 1 LEADER]: Becoming Leader. State: Replica: be1a4846199340c39358a0f3ffe209b8, State: Running, Role: LEADER
I20260810 14:35:12.467365 27002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.469408 27002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:12.470160 26975 consensus_queue.cc:237] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } }
W20260810 14:35:12.470456 27018 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:12.470546 27018 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260810 14:35:12.472009 27020 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:35:12.472100 27020 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:35:12.477550 26975 sys_catalog.cc:455] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be1a4846199340c39358a0f3ffe209b8. Latest consensus state: current_term: 1 leader_uuid: "be1a4846199340c39358a0f3ffe209b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.477772 26975 sys_catalog.cc:458] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:12.480392 26807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.467645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43364 (local address 127.1.206.126:35569)
0810 14:35:12.467762 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.467767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.469570 (+ 1803us) server_negotiation.cc:407] Connection header received
0810 14:35:12.469761 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.469764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.469812 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.469862 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.470908 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.471672 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.472906 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.473237 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.473341 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.475272 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.475276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.475278 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.475303 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.477125 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.478851 (+ 1726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.478855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.478858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.478954 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.479290 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.479294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.479296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.479545 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.479665 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.480078 (+ 413us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.480205 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 14:35:12.483225 26985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.483373 26985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:12.484834 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.468316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41882 (local address 127.1.206.125:35121)
0810 14:35:12.468420 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.468424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.473101 (+ 4677us) server_negotiation.cc:407] Connection header received
0810 14:35:12.473336 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.473339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.473398 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.473453 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.474435 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.475178 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.476390 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.476730 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.476812 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.480110 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.480114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.480120 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.480147 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.481852 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.483102 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.483106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.483108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.483203 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.483730 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.483734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.483736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.484013 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.484129 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.484521 (+ 392us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.484646 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:35:12.485744 27027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:35:12.486855 27027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:35:12.494985 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:12.468889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45820 (local address 127.1.206.124:38861)
0810 14:35:12.468989 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.468993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.478284 (+ 9291us) server_negotiation.cc:407] Connection header received
0810 14:35:12.484408 (+ 6124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.484411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.484471 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.484524 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.487120 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.487930 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.489109 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:12.489455 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:12.489527 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:12.491323 (+ 1796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:35:12.491327 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:35:12.491330 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:35:12.491357 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:35:12.493092 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.493596 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.493600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.493602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.493685 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:35:12.493993 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:35:12.493996 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:35:12.493998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:35:12.494216 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:35:12.494331 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:12.494690 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 14:35:12.494815 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:35:12.499682 26938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [term 1 FOLLOWER]: Refusing update from remote peer be1a4846199340c39358a0f3ffe209b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:35:12.499893 26857 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [term 1 FOLLOWER]: Refusing update from remote peer be1a4846199340c39358a0f3ffe209b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:35:12.500738 26975 consensus_queue.cc:1035] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:35:12.501200 26975 consensus_queue.cc:1035] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:35:12.508355 27002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be1a4846199340c39358a0f3ffe209b8. Latest consensus state: current_term: 1 leader_uuid: "be1a4846199340c39358a0f3ffe209b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.508484 27002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:12.508919 26985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be1a4846199340c39358a0f3ffe209b8. Latest consensus state: current_term: 1 leader_uuid: "be1a4846199340c39358a0f3ffe209b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.509043 26985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:12.515409 27023 sys_catalog.cc:455] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "be1a4846199340c39358a0f3ffe209b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.515580 27023 sys_catalog.cc:458] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:12.516647 27002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "be1a4846199340c39358a0f3ffe209b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.516782 27002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:12.517244 27028 mvcc.cc:205] Tried to move back new op lower bound from 7316981811191504896 to 7316981811082489856. Current Snapshot: MvccSnapshot[applied={T|T < 7316981811191504896}]
I20260810 14:35:12.517710 27029 sys_catalog.cc:455] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "be1a4846199340c39358a0f3ffe209b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.517849 27029 sys_catalog.cc:458] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8 [sys.catalog]: This master's current role is: LEADER
I20260810 14:35:12.519027 26985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "be1a4846199340c39358a0f3ffe209b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be1a4846199340c39358a0f3ffe209b8" member_type: VOTER last_known_addr { host: "127.1.206.126" port: 35569 } } peers { permanent_uuid: "9f5b128dc22e47feafa360ad7781e8d6" member_type: VOTER last_known_addr { host: "127.1.206.125" port: 35121 } } peers { permanent_uuid: "5758e766b9f946b89c2b03c20b93e143" member_type: VOTER last_known_addr { host: "127.1.206.124" port: 38861 } } }
I20260810 14:35:12.519148 26985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:35:12.519502 27030 mvcc.cc:205] Tried to move back new op lower bound from 7316981811191504896 to 7316981811082489856. Current Snapshot: MvccSnapshot[applied={T|T < 7316981811191504896}]
I20260810 14:35:12.519600 27027 catalog_manager.cc:1347] Generated new cluster ID: b346f14cc63a4a809f95ef27c2a2adc7
I20260810 14:35:12.519661 27027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:35:12.520035 27032 mvcc.cc:205] Tried to move back new op lower bound from 7316981811191504896 to 7316981811082489856. Current Snapshot: MvccSnapshot[applied={T|T < 7316981811191504896}]
I20260810 14:35:12.555977 27027 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:35:12.557389 27027 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:35:12.571702 27027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be1a4846199340c39358a0f3ffe209b8: Generated new TSK 0
I20260810 14:35:12.572752 27027 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:35:12.609248 26807 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.605681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43372 (local address 127.1.206.126:35569)
0810 14:35:12.605814 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.605819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.607865 (+ 2046us) server_negotiation.cc:407] Connection header received
0810 14:35:12.608308 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.608312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.608370 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.608426 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.609090 (+ 664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43372: BlockingRecv error: recv got EOF from 127.0.0.1:43372 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260810 14:35:12.610415 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.606453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41890 (local address 127.1.206.125:35121)
0810 14:35:12.606565 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.606569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.608181 (+ 1612us) server_negotiation.cc:407] Connection header received
0810 14:35:12.609629 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.609632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.609701 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.609754 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.610293 (+ 539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41890: BlockingRecv error: recv got EOF from 127.0.0.1:41890 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 14:35:12.612020 26969 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.607274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45826 (local address 127.1.206.124:38861)
0810 14:35:12.607408 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.607413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.610913 (+ 3500us) server_negotiation.cc:407] Connection header received
0810 14:35:12.611282 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.611285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.611334 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.611387 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.611883 (+ 496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45826: BlockingRecv error: recv got EOF from 127.0.0.1:45826 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 14:35:12.615911 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.614387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.1.206.125:35121)
0810 14:35:12.614488 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.614492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.615010 (+ 518us) server_negotiation.cc:407] Connection header received
0810 14:35:12.615217 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.615220 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.615289 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.615341 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.615816 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41894: BlockingRecv error: recv got EOF from 127.0.0.1:41894 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 14:35:12.620800 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.619197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41908 (local address 127.1.206.125:35121)
0810 14:35:12.619298 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.619301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.619838 (+ 537us) server_negotiation.cc:407] Connection header received
0810 14:35:12.620033 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.620036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.620092 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.620143 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.620701 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41908: BlockingRecv error: recv got EOF from 127.0.0.1:41908 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 14:35:12.626510 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.624858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41922 (local address 127.1.206.125:35121)
0810 14:35:12.624959 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.624963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.625495 (+ 532us) server_negotiation.cc:407] Connection header received
0810 14:35:12.625697 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.625700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.625750 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.625802 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.626385 (+ 583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41922: BlockingRecv error: recv got EOF from 127.0.0.1:41922 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 14:35:12.634405 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.632621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41930 (local address 127.1.206.125:35121)
0810 14:35:12.632778 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.632782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.633423 (+ 641us) server_negotiation.cc:407] Connection header received
0810 14:35:12.633624 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.633629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.633708 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.633761 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.634304 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41930: BlockingRecv error: recv got EOF from 127.0.0.1:41930 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260810 14:35:12.646633 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.644805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41940 (local address 127.1.206.125:35121)
0810 14:35:12.644933 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.644939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.645566 (+ 627us) server_negotiation.cc:407] Connection header received
0810 14:35:12.645801 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.645805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.645865 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.645922 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.646517 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41940: BlockingRecv error: recv got EOF from 127.0.0.1:41940 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 14:35:12.674522 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.672763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41952 (local address 127.1.206.125:35121)
0810 14:35:12.672896 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.672902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.673520 (+ 618us) server_negotiation.cc:407] Connection header received
0810 14:35:12.673746 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.673750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.673803 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.673856 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.674401 (+ 545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41952: BlockingRecv error: recv got EOF from 127.0.0.1:41952 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 14:35:12.710664 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.709322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41968 (local address 127.1.206.125:35121)
0810 14:35:12.709456 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.709461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.709735 (+ 274us) server_negotiation.cc:407] Connection header received
0810 14:35:12.709909 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.709919 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.709971 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.710059 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.710535 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41968: BlockingRecv error: recv got EOF from 127.0.0.1:41968 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 14:35:12.778142 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.777055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41984 (local address 127.1.206.125:35121)
0810 14:35:12.777217 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.777223 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.777356 (+ 133us) server_negotiation.cc:407] Connection header received
0810 14:35:12.777481 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.777484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.777534 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.777621 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.778037 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41984: BlockingRecv error: recv got EOF from 127.0.0.1:41984 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260810 14:35:12.909587 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:12.908334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41996 (local address 127.1.206.125:35121)
0810 14:35:12.908512 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:12.908517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:12.908658 (+ 141us) server_negotiation.cc:407] Connection header received
0810 14:35:12.908845 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:12.908848 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:12.908906 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:12.909000 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:12.909472 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41996: BlockingRecv error: recv got EOF from 127.0.0.1:41996 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260810 14:35:13.169013 26890 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:35:13.167807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42000 (local address 127.1.206.125:35121)
0810 14:35:13.167985 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:13.167988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:13.168006 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:35:13.168161 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:13.168164 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:13.168214 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:13.168309 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:35:13.168850 (+ 541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42000: BlockingRecv error: recv got EOF from 127.0.0.1:42000 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 14:35:13.471868 27018 catalog_manager.cc:1259] Loaded cluster ID: b346f14cc63a4a809f95ef27c2a2adc7
I20260810 14:35:13.471961 27018 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: loading cluster ID for follower catalog manager: success
I20260810 14:35:13.473152 27020 catalog_manager.cc:1259] Loaded cluster ID: b346f14cc63a4a809f95ef27c2a2adc7
I20260810 14:35:13.473238 27020 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: loading cluster ID for follower catalog manager: success
I20260810 14:35:13.473702 27018 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: acquiring CA information for follower catalog manager: success
I20260810 14:35:13.474782 27020 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: acquiring CA information for follower catalog manager: success
I20260810 14:35:13.474854 27018 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5758e766b9f946b89c2b03c20b93e143: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:35:13.475796 27020 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9f5b128dc22e47feafa360ad7781e8d6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:35:13.687263 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:13.683064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42014 (local address 127.1.206.125:35121)
0810 14:35:13.683326 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:13.683333 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:13.683441 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:35:13.683620 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:13.683624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:13.683761 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:13.683908 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:13.684181 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.684734 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.685613 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.685949 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.686060 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:13.686416 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:13.686854 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:13.686996 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:13.687036 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 14:35:13.687095 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":73,"threads_started":1}
I20260810 14:35:13.693849 27114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:13.690383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45834 (local address 127.1.206.124:38861)
0810 14:35:13.690594 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:13.690597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:13.690612 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:35:13.690709 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:13.690711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:13.690818 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:13.690914 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:13.691097 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.691628 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.692496 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.692724 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.692805 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:13.693042 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:13.693456 (+ 414us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:13.693552 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:13.693607 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 14:35:13.693654 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":71,"threads_started":1}
I20260810 14:35:13.701448 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:13.697222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42028 (local address 127.1.206.125:35121)
0810 14:35:13.697387 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:13.697393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:13.697496 (+ 103us) server_negotiation.cc:407] Connection header received
0810 14:35:13.697735 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:13.697741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:13.697803 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:13.697893 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:13.698199 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.698887 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.700318 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.700548 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.700663 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:13.700950 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:13.701044 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:13.701116 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:13.701250 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 14:35:13.701310 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 14:35:13.701866 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:13.696938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43380 (local address 127.1.206.126:35569)
0810 14:35:13.697512 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:13.697517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:13.697533 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:35:13.697679 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:13.697685 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:13.697872 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:13.698042 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:13.698331 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.699054 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.700327 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.700561 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.700683 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:13.701087 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:13.701463 (+ 376us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:13.701565 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:13.701644 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 14:35:13.701728 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":123,"threads_started":1}
I20260810 14:35:13.702064 27114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:35:13.697617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45842 (local address 127.1.206.124:38861)
0810 14:35:13.697770 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 14:35:13.697774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:35:13.698045 (+ 271us) server_negotiation.cc:407] Connection header received
0810 14:35:13.698212 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:35:13.698215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:35:13.698267 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:35:13.698335 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:35:13.698665 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.699329 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.700738 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:35:13.701070 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:35:13.701199 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:35:13.701573 (+ 374us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:35:13.701658 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:35:13.701704 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:35:13.701885 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 14:35:13.701944 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 14:35:13.708738 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26729
I20260810 14:35:13.716140 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26811
I20260810 14:35:13.724450 1849 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskN56qvq/build/debug/bin/kudu with pid 26892
2026-08-10T14:35:13Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3218 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6456 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (293831 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST